-- Logs begin at Fri 2022-08-05 18:48:17 UTC, end at Fri 2022-08-05 20:23:00 UTC. -- Aug 05 19:49:59.560575 dv-cinder-852211-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 19:49:59.569931 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 19:49:59 2022] *** Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: nodename: dv-cinder-852211-3-iscsi Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: machine: x86_64 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: clock source: unix Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: pcre jit disabled Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: detected number of CPU cores: 4 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: current working directory: / Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: detected binary path: /usr/bin/uwsgi-core Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: your processes number limit is 47680 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: your memory page size is 4096 bytes Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: detected max file descriptor number: 2048 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: lock engine: pthread robust mutexes Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: thunder lock: enabled Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 19:49:59.573969 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 19:49:59.612905 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: Python main interpreter initialized at 0x55be565a19c0 Aug 05 19:49:59.612905 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: python threads support enabled Aug 05 19:49:59.612905 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: your server socket listen backlog is limited to 100 connections Aug 05 19:49:59.612905 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: your mercy for graceful operations on workers is 90 seconds Aug 05 19:49:59.613268 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 19:49:59.613342 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: *** Operational MODE: preforking *** Aug 05 19:49:59.613592 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: *** uWSGI is running in multiple interpreter mode *** Aug 05 19:49:59.613592 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: spawned uWSGI master process (pid: 80510) Aug 05 19:49:59.613797 dv-cinder-852211-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 05 19:49:59.614874 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: spawned uWSGI worker 1 (pid: 80519, cores: 1) Aug 05 19:49:59.614874 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: spawned uWSGI worker 2 (pid: 80520, cores: 1) Aug 05 19:49:59.614874 dv-cinder-852211-3-iscsi devstack@keystone.service[80510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 19:50:05.158860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:50:05.158860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Aug 05 19:50:05.159659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:50:05.159659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: from cryptography.utils import int_from_bytes Aug 05 19:50:05.160160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:50:05.160160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Aug 05 19:50:05.160272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:50:05.160272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: from cryptography.utils import int_from_bytes Aug 05 19:50:05.209764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:50:05.209923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:50:05.210019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:50:05.210110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:50:05.210189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] command line args: [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:50:05.210265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] command line args: [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:50:05.210384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:50:05.210475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:50:05.210547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ================================================================================ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:50:05.210624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ================================================================================ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:50:05.210806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.210887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] admin_token = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] config_dir = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] config_dir = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] config_source = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] config_source = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] debug = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] debug = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.211741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.212956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_config_append = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_config_append = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_dir = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_dir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.213970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.214895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.215806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.216924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.95/identity {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.95/identity {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] publish_errors = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] publish_errors = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.217755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.218569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.218660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.218734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.218806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.218928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] standard_threads = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] standard_threads = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.219842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] use_journal = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] use_json = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] use_journal = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] use_stderr = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] use_json = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] use_syslog = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] use_stderr = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] use_syslog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.220961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.221104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:50:05.221195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.221903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.222886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.223984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.224932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.225959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.226900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.227883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.228936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.229980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.230998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.231958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.232906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.233988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.234906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.235890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.236981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.237912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.238901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.239974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.240915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.241993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.242959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.243989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.244938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.245996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.external = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.external = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.246975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.password = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.password = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.token = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.token = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.247968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.248909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.249036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.249715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.249853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.249980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.250980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.251967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.252783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.253970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.254920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.255887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.256968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.257986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.258943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.259886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.260849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.261961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.262890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.263971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.264792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.265501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.265699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.265884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.266896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.267896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.268983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.269913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.270987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.271950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.272893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.273939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.274999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.275968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.276914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.277983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.278938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.279896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.280896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] role.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] role.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.281913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] role.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] role.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.282984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.283905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.284957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.285910 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.286951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.287918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.288992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.289944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.290768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.291983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.292938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.293888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.294967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.295870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.296938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.297891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:50:05.298612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:50:05.324707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.324876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.324988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.325073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.325152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.325231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.334145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.334342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.363599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.363788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.363871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.363966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.418842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.419472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.467730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.468123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.468789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.469098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.533937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.534805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.557869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.558705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.570293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.570435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.583932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.584905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.585044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 19:50:05.602637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.602851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 19:50:05.603155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.603353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 19:50:05.603620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.603905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.604161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.604410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.605666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.605875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 19:50:05.606202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.606397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 19:50:05.606659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.606911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.607164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.607412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.614984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.615264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.615530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.615831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.617780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.618051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.618312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.618588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.622674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.625832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.627499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.627800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.628075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.628355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.628777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.629034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.629298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.629568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.629840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.630110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.630374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.630510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.630780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.631056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.631333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.631636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.631881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.632146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.632412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.632672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.632937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.633192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.653886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.656013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.656292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.657830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.659306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.659580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.661005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.661288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.661557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.664150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.664426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.664702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.668349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.668627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.671750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.671998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.673283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.673566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.673845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.674204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.674607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.674895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.675254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.675685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.676144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.676425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.676706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.676992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.677269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.677545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.677816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.678096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.693042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.693314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.693946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.694218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.697227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.698108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.700352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.700644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.701219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.701508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.705523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.706365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.709527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.709703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.712711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.712856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.713981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.714112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.714251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.730492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.730767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.730897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.731037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.731163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.731300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.731427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.731655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.738145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.738848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.739651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.739942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.740410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.740689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.742731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.743016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.743299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.743501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.743630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.743808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.743939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.744108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.744389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.744663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.755099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.755365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.755639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.755944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.756218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.756347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.756482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.756610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.756736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.756861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.757089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.757363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.757639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.757917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.772577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.774147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.775517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.777252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.778460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.780179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.781674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.783156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.783298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.783426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.783698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.784776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.785070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.785363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.790055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.791916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.792156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.793746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.794820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.795102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.795378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.795645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.796715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.796998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.797282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.797558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.803631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.803988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.804213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.805639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.805923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.806200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.810977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.811246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.811521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.812000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.812348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.812617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.812885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 19:50:05.813222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.814977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.815255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.815541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.815834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.816099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.816375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.816645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 19:50:05.852149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be565a19c0 pid: 80520 (default app) Aug 05 19:50:05.852397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be565a19c0 pid: 80519 (default app) Aug 05 19:50:05.855561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8cd7-46c0-473e-82bc-98515cfbe06d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:05.855878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8cd7-46c0-473e-82bc-98515cfbe06d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:05.856151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8cd7-46c0-473e-82bc-98515cfbe06d None None] PATH_INFO: `/v3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:05.860832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1/1] 10.222.0.95 () {50 vars in 791 bytes} [Fri Aug 5 19:50:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:13.553210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:13.553766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:13.553766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:13.558136 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1/2] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:13.564576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:13.565001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:13.565121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:13.637530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: INFO dbcounter [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] Registered counter for database keystone Aug 05 19:50:13.657612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:50:13.664150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writer thread running {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:50:13.844419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80520) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 19:50:13.844747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80520) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 19:50:13.899501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:13.901131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:14.046177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 2/3] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 05 19:50:14.197656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:14.267789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: INFO dbcounter [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] Registered counter for database keystone Aug 05 19:50:14.292482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG oslo_db.sqlalchemy.engines [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:50:14.299189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writer thread running {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:50:14.421206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f3c58-a7f4-431d-b951-0b2d651c6662 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:14.425585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:14.426228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:14.426508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:14.427120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:14.435205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:14.487418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 19:50:14.487688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb874b-3271-4096-8d1d-918056190914 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:14.497479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 2/4] 10.222.0.95 () {58 vars in 1324 bytes} [Fri Aug 5 19:50:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 19:50:14.504080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:14.519196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7aedf-cfba-47f9-abb7-f7ff8370c327 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:14.523573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:14.524705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:14.524984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:14.525252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] PATH_INFO: `/v3/projects/77f7a859119a4ba5a9748b0c556b058a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:14.526725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] RBAC: Authorizing `identity:get_project(project_id=77f7a859119a4ba5a9748b0c556b058a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:14.577718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 19:50:14.578276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc3c15-a838-47d5-a1f0-c342e0e7481e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:14.582723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 3/5] 10.222.0.95 () {56 vars in 1207 bytes} [Fri Aug 5 19:50:14 2022] GET /identity/v3/projects/77f7a859119a4ba5a9748b0c556b058a => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:16.594489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b27c-3568-4339-bf4f-3c71e8d7f051 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:16.595023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b27c-3568-4339-bf4f-3c71e8d7f051 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:16.595023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b27c-3568-4339-bf4f-3c71e8d7f051 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:16.599158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 3/6] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:16.604579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:16.604979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:16.605126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:16.625564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:16.627047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:16.634849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 4/7] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 19:50:16.657127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b27c-3568-4339-bf4f-3c71e8d7f051 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:16.669434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b27c-3568-4339-bf4f-3c71e8d7f051 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:16.674377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:16.674979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:16.675262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:16.675536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:16.683261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:16.685001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3887-3daf-4c5f-8cef-8f3cf0217e0b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:16.693966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 4/8] 10.222.0.95 () {58 vars in 1324 bytes} [Fri Aug 5 19:50:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 19:50:16.699300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:16.708270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca86c-3d9d-4852-98af-348c6d019bd1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:16.712591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:16.713214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:16.713488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:16.713757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:16.715084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:16.717407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25a73-594a-4595-a24d-95c02b13210a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:16.718929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 5/9] 10.222.0.95 () {56 vars in 1198 bytes} [Fri Aug 5 19:50:16 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:18.774013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163dc9a-bddc-4244-8306-4e86a4bcc447 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:18.774497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163dc9a-bddc-4244-8306-4e86a4bcc447 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:18.774497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163dc9a-bddc-4244-8306-4e86a4bcc447 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:18.775852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 5/10] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:18.783716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:18.784290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:18.784290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:18.803770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:18.804965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:18.850391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd9ba-f689-432d-81b8-e202b253f66b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:18.850672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd9ba-f689-432d-81b8-e202b253f66b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:18.850939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd9ba-f689-432d-81b8-e202b253f66b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:18.852293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 6/11] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:18.857423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:18.857710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:18.857984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:18.885344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 6/12] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:18.901897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG passlib.handlers.bcrypt [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80519) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 19:50:18.902332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG passlib.handlers.bcrypt [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80519) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 19:50:18.908139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:18.930905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:18.948882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:18.950502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:19.012159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4d3e-1059-41cd-b907-ce0541290563 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.046819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.047381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.047655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.047952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.051339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 7/13] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:19.064139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:19.073351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:19.074410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:19.077249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:19.078030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.078116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 7/14] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:19.081015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.160460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.176346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6a8d3-f8a7-4506-8b88-eb614ef6c265 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.178620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.182061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740a377-424a-4505-8cc6-ab1c9918435b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.215549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.217115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.217440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.217751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.218979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.219605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.219907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.220180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.220909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:19.221210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.222602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.235173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 8/15] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:19.240769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.289229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.291007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.342226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131317c2-1170-4ff8-a39c-a5546d9240bc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.391538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 8/16] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:19.397609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.400912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.485547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.486196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.486550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.486826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.488510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.489955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.491586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 9/17] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:19.496993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.506095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5e94-0cbd-4141-8b56-b3e420b48a21 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.512171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.542737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.543604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.543914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.544197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.563502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.565209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:50:19.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:19.584818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:19.585582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:50:19.585582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:50:19.585582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:50:19.585582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:19.585582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 9/18] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:19.590706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.596708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb739d-f342-4930-a2ca-c039a339745c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.630061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.630700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.630977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.631245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.632415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.633880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.635592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 10/19] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:19.641647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:19.646647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.691524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45be50-bea2-4250-8d88-7ebc07ae3292 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.722525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:19.725279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.725909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.726189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.726473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.727163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:19.727469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.728873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44126efb-2559-48d6-a3e7-1fe5d89386ef None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.743192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3655b-a39d-4630-afc4-941dce80d63e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:19.750750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 10/20] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:19.781480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:19.782126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:19.782409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:19.782686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:19.783500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.domain.id=default, user.id=72bbdec94ebd4a7ead34c004dcfc40eb) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:19.783843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:19.785313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90346c57-298f-498a-9c30-59a62cdd6137 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:19.793313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 11/21] 10.222.0.95 () {56 vars in 1322 bytes} [Fri Aug 5 19:50:19 2022] GET /identity/v3/role_assignments?user.id=72bbdec94ebd4a7ead34c004dcfc40eb&scope.domain.id=default&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:22.155934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c32b-d4b5-4532-bc01-4b76b28a08ef None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.156472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c32b-d4b5-4532-bc01-4b76b28a08ef None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.156472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c32b-d4b5-4532-bc01-4b76b28a08ef None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.157982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 11/22] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:22.166915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.166915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.166915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.184197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:22.186443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:22.257738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 12/23] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:22.281535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c32b-d4b5-4532-bc01-4b76b28a08ef None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:22.415657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c32b-d4b5-4532-bc01-4b76b28a08ef None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:22.446361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:22.474322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:22.475338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.475901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.476380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.488129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:22.489910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a0440810-b382-4fa1-83c0-d11a2fc9ebe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:50:22.510321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:22.511171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:22.511973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:50:22.511973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:50:22.511973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:50:22.511973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:22.514119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 12/24] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:22.520303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:22.604379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce67e-d86a-45d4-b3ae-3d2dce6a78a4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce67e-d86a-45d4-b3ae-3d2dce6a78a4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.605733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce67e-d86a-45d4-b3ae-3d2dce6a78a4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.608168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 13/25] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:22.614005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f37-8d2e-4edf-8aac-fdd57f892165 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.614822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f37-8d2e-4edf-8aac-fdd57f892165 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.615543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f37-8d2e-4edf-8aac-fdd57f892165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.642573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:22.644518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-30866f37-8d2e-4edf-8aac-fdd57f892165 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:22.645936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-30866f37-8d2e-4edf-8aac-fdd57f892165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:22.700743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc800c-c3b6-4532-9f1f-1c9555b1ea73 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:22.750888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:22.751809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.752226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.752676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.753377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:22.753823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:22.755341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c05aa-b62e-4977-b80b-48d4abc163fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:22.757753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 14/26] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:22.759289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b72c1-eb82-4772-9a9c-f5f1f61e05b1 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.759763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b72c1-eb82-4772-9a9c-f5f1f61e05b1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.760224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b72c1-eb82-4772-9a9c-f5f1f61e05b1 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.761608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 15/27] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:22.762764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da2f71-3da7-497a-a2ea-88fdbda6d421 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.763267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da2f71-3da7-497a-a2ea-88fdbda6d421 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.763727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da2f71-3da7-497a-a2ea-88fdbda6d421 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.765785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 16/28] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:22.769216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.769677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.770119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.786462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 13/29] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:22.788040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:22.788524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:22.788967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:22.808118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:22.809646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:22.813601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:22.815113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:22.908348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 14/30] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:22.909302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:22.982318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.026000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b63a5-96cf-4306-a7f4-9eb97b042791 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.047151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 17/31] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 19:50:23.048688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.079730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:23.080402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.080680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.080957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.081641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:23.083109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:23.096803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.192074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d747-1251-4000-8ddd-de35f9b2dd51 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.231587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:23.232692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.232977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.233354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.234145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:23.235591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:23.250011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 15/32] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:50:22 2022] POST /identity/v3/projects => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:23.251567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.384902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 18/33] 10.222.0.95 () {60 vars in 1131 bytes} [Fri Aug 5 19:50:23 2022] POST /identity/v3/roles => generated 225 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:23.386077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.389055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf81b0-64bc-406a-8229-d6a8d104bbd3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.410181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.443146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:23.444138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.444566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.444986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.445888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:23.447626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:23.477473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 16/34] 10.222.0.95 () {60 vars in 1131 bytes} [Fri Aug 5 19:50:23 2022] POST /identity/v3/roles => generated 219 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:23.528350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.547303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a8301-c850-4b9a-a6a3-26f2d835f2d9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.596314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:23.597005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.597289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.597634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.612585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5e86de38-56a5-4c1c-8466-66a308380e8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:23.622348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:23.623740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:23.624566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 19/35] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:23.629986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.682119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6892e-7eec-495c-998d-39f8dce525b1 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.682420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6892e-7eec-495c-998d-39f8dce525b1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.682725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6892e-7eec-495c-998d-39f8dce525b1 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.687319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 20/36] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:23.700737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.701126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.701274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.724596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:23.726424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:23.768301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ab6-38ca-4cf3-926c-fe229b9f36f5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.812766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 21/37] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:23.821933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:23.822580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:23.822861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:23.823186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:23.823998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:23.824357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:23.826505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:23.837265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 17/38] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:23.841108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.847513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:23.902733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.942245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:23.967228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cb473-cbce-4c8a-a005-3da77be088a4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:23.972927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98310-6199-4cd7-8e00-244c0cfb8c37 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:24.006769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.006981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.007420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.007539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.007704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.007823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.008016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.008117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.009388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.009490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.010831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f859d9-bb5a-4e8e-81f6-33b849bb9e9e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.010996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.012494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 18/39] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:23 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:24.012640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 22/40] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:24.014699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7308-7920-4a24-8016-82cc8f5e6d6c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.014957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7308-7920-4a24-8016-82cc8f5e6d6c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.015231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7308-7920-4a24-8016-82cc8f5e6d6c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.016662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 19/41] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:24.019942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:24.020082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce7308-7920-4a24-8016-82cc8f5e6d6c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:24.120712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf9373-79cf-49f0-a387-d883200444ed None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:24.125053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce7308-7920-4a24-8016-82cc8f5e6d6c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:24.133184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:24.155148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.155799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.156205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.156349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.157487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.158996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767ea51-8fc3-4a34-b26f-6b66feea9933 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.160690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 23/42] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:24.161727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.161856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.162054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.162327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.162436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.162629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.162905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.163586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.165434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.180450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:24.181655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:24.192701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:24.194040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 20/43] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:50:24 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:50:24.195011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:24.264839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 24/44] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:24.288418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:24.324190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeec98-2353-4b7a-a1ff-3b63a7fd4187 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:24.366003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.366807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.367092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.367376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] PATH_INFO: `/v3/domains/default/users/72bbdec94ebd4a7ead34c004dcfc40eb/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.369516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=72bbdec94ebd4a7ead34c004dcfc40eb, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.371196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a7e20-d5fa-4c2b-ad03-9210c04f633b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.395882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 21/45] 10.222.0.95 () {58 vars in 1361 bytes} [Fri Aug 5 19:50:24 2022] PUT /identity/v3/domains/default/users/72bbdec94ebd4a7ead34c004dcfc40eb/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:24.410084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f00e1-82b2-48a5-9773-15957018a00f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:24.454606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4213-5540-404f-881e-086055ab7627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:24.455697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4213-5540-404f-881e-086055ab7627 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:24.456310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4213-5540-404f-881e-086055ab7627 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:24.456745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4213-5540-404f-881e-086055ab7627 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:24.457688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4213-5540-404f-881e-086055ab7627 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:24.459299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4213-5540-404f-881e-086055ab7627 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:24.478216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 25/46] 10.222.0.95 () {60 vars in 1131 bytes} [Fri Aug 5 19:50:24 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:50:26.377997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba72-aedd-4f9d-a088-a4ea27879281 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.378550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba72-aedd-4f9d-a088-a4ea27879281 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.378550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba72-aedd-4f9d-a088-a4ea27879281 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.379964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 22/47] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:26.385373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.385792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.386005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.394518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:26.407105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:26.408350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:26.469668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933f43-77da-43f3-85aa-9c50a23d5703 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.469950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933f43-77da-43f3-85aa-9c50a23d5703 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.470236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933f43-77da-43f3-85aa-9c50a23d5703 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.471604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 23/48] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:26.476870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.477171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.477445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.486294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 26/49] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:26.498408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:26.499955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:26.510093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:26.514468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:26.571578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 24/50] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:26.595334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:26.621352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb2331-5064-4a88-8c97-56df04142821 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:26.655519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:26.656122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.656399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.656749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.657818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:26.659243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:26.660860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 27/51] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:26.666616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:26.670379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:26.701718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809313-74d0-4cf5-92a8-0b973b6f0716 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:26.735297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:26.736133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.736388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.736663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.746442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:26.751763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:26.752691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:26.753623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 25/52] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:26.758694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:26.769853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:26.770115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6d5a-f8b4-46a4-8b5e-9bba2ce58e2c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:26.804260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:26.804886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.805163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.805437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.806104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:26.807522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:26.835266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 28/53] 10.222.0.95 () {60 vars in 1140 bytes} [Fri Aug 5 19:50:26 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:26.863400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447fae7-2741-4290-88fc-dbcce4e07f73 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:26.900526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:26.901232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:26.901518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:26.901793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:26.902585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:26.902901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:26.904706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:26.914544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 26/54] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:26.920959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:26.979946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:27.027497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5528-0033-4f3a-a110-6c73e31a62fc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:27.061697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:27.062351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:27.062631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:27.062906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:27.064327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:27.065762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:27.067549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 29/55] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:26 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:27.072889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:27.144167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:27.176842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759271-6ac0-4307-95ee-3f237d855228 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:27.209673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:27.210322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:27.210607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:27.210882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:27.212064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:27.213501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d885e4-22a3-4397-8d80-960edbeb2a0a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:27.215086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 27/56] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:27.221546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:27.320437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ee6c4-e0e4-4ee9-8278-75524fc1d264 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:27.343557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:27.355835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:27.357163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:27.357525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:27.357800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:27.358588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.domain.id=default, user.id=72bbdec94ebd4a7ead34c004dcfc40eb) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:27.358898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:27.360398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ff238-97c1-4c37-902d-71143e78d149 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:27.369595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 30/57] 10.222.0.95 () {56 vars in 1322 bytes} [Fri Aug 5 19:50:27 2022] GET /identity/v3/role_assignments?user.id=72bbdec94ebd4a7ead34c004dcfc40eb&scope.domain.id=default&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:28.874487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2b48-da5b-45f7-a37c-32792322cd6e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:28.874986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2b48-da5b-45f7-a37c-32792322cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:28.874986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2b48-da5b-45f7-a37c-32792322cd6e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:28.876458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 28/58] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:28.883128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:28.883521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:28.883687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:28.906629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:28.908572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:28.975636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 31/59] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:28.999607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2b48-da5b-45f7-a37c-32792322cd6e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:29.096954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd2b48-da5b-45f7-a37c-32792322cd6e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:29.130494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:29.131022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:29.131308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:29.131588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:29.132795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:29.134232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95400b58-533f-4f72-86f3-005f98c7ca0b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:29.135847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 29/60] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:29.141881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:29.244636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fc69-280b-4362-9dcb-29893049f307 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:29.260368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:29.277567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:29.278722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:29.279082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:29.279359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:29.280053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:29.281494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ef2a-43e1-4c70-9a75-c5147a878639 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:29.307399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 32/61] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:29 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:32.530137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7dc5-1f1d-4257-b244-626a1aec790b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.531095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7dc5-1f1d-4257-b244-626a1aec790b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.531611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e7dc5-1f1d-4257-b244-626a1aec790b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.533301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 30/62] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:32.539272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48f16-efa9-462b-a08e-8125e1b1a3cc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.540185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48f16-efa9-462b-a08e-8125e1b1a3cc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.540678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48f16-efa9-462b-a08e-8125e1b1a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.568813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1dc48f16-efa9-462b-a08e-8125e1b1a3cc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:32.570352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1dc48f16-efa9-462b-a08e-8125e1b1a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:32.656594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 33/63] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:32.692189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899122-506a-4d19-9c62-113df8facd57 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.692724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40053-677b-4642-a365-39e2231fa08a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.693013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40053-677b-4642-a365-39e2231fa08a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.693226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899122-506a-4d19-9c62-113df8facd57 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.693321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40053-677b-4642-a365-39e2231fa08a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.693774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899122-506a-4d19-9c62-113df8facd57 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.694771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 34/64] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:32.695376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40053-677b-4642-a365-39e2231fa08a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:32.696024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 31/65] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:32.700005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631167-5e05-4cb4-8de3-03ec9f3ed38e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.700508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631167-5e05-4cb4-8de3-03ec9f3ed38e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.700981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631167-5e05-4cb4-8de3-03ec9f3ed38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.714398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:32.722913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-27631167-5e05-4cb4-8de3-03ec9f3ed38e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:32.724132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-27631167-5e05-4cb4-8de3-03ec9f3ed38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:32.811869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 32/66] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:32.811869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.811869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.811869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.830519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:32.831806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:32.852526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40053-677b-4642-a365-39e2231fa08a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:32.854481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:32.891596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:32.892647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.893164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.893628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.904897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:32.908157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 33/67] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-158d5563-2cf3-4756-a78f-361b5b31498b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:32.912121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:32.913035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:32.914039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:32.916182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:32.916931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 35/68] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:32.919190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca61be-484a-4493-b423-0c577acfbcaf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:32.919696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca61be-484a-4493-b423-0c577acfbcaf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:32.920212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca61be-484a-4493-b423-0c577acfbcaf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:32.922323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 36/69] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:32.924022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca61be-484a-4493-b423-0c577acfbcaf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.000070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.039601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dadd2-74bc-4c1f-bfeb-6de15d54c9c5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.044503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca61be-484a-4493-b423-0c577acfbcaf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.076490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.077140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.077419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.077689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.079120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.079808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.080087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.080362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.081073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:33.081382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.082750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.087992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-76d9c7a2-cf9c-4226-b807-1a62056c60b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:33.092995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:33.094027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:33.094786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 34/70] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:33.095407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 37/71] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:33.095472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c231b-9b14-47cc-b87f-c951169b78ee None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.095542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c231b-9b14-47cc-b87f-c951169b78ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.095605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.099822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c231b-9b14-47cc-b87f-c951169b78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.114753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a33c231b-9b14-47cc-b87f-c951169b78ee None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:33.115983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a33c231b-9b14-47cc-b87f-c951169b78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:33.124959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.183322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 35/72] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:33.185533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6738-55e7-44b1-b33f-ee8500ab225a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.185822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6738-55e7-44b1-b33f-ee8500ab225a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.186101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6738-55e7-44b1-b33f-ee8500ab225a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.187381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 36/73] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:33.192457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6738-55e7-44b1-b33f-ee8500ab225a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.205327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547aecd5-6dfa-4d9a-a5ad-83e20538cbb9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.239200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.239872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.240142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.240415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.250548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.251568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:33.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:33.257197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:33.258106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 38/74] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:33.258847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.299800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6738-55e7-44b1-b33f-ee8500ab225a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.334916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.335546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.335852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.336129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.336854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:33.337155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.338543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d992f0-713a-434a-96a6-44522af463ec None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.346841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 37/75] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:33.348033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.348317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.348593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.359890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.366424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:33.367633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:33.376475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d0e3e-b953-4054-bd11-3a246f225694 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.410710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.411446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.411729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.412042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.431503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.433003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.436278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 39/76] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:33.441029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 38/77] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:33.441165 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.441254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.497402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.541102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46ad0a-bc73-4f05-a43a-e6cbadae1f09 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.547305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0652-5a1d-4f77-bfdd-22b81e6e28be None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.576196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.576834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.577113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.577384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.582064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.582687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.582967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.583297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.584045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:33.584351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.585713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.587771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:33.592733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:33.593550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:33.594355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:33.594999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 39/78] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:33.595075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 40/79] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:33.595146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.596705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.600309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.698550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de53c1a-1c49-421e-a794-fcd87383ec5c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.698790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74c5a-f681-41e5-88da-16f205fd55e6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.709303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.733517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.734156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.734285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.734434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.734697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.734836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.735238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.735464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.736019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.737453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.739180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 40/80] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:33.739965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.802835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.804249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.806161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.851855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb8c7-724a-4cda-996d-1b4791358db2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:33.884841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:33.885490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:33.885770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:33.886047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:33.888087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:33.889497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:33.891086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 41/81] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:33.891868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.909141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 41/82] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:33.909984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:33.941873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:33.998252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a5f3-e5c4-499e-bd08-34241c69db00 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.009393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123bf8-3ba6-4996-ac03-72a7b2023283 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.010943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.032863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.033510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.033793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.034077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.035246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.036737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.038589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 42/83] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.039354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.048962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.049588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.049870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.050145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.050859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:34.051163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.052549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.061185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 42/84] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.061903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.141641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae20522-1eba-445a-9903-b7dbb1387832 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.155473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.162042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46342-2476-416e-9f55-2a4e09f6ec28 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.176208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.176824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.177104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.177377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.194501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.195113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.195390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.195667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.196366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.197780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.219747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 43/85] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:34 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:34.220584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.250719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.253259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.258455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.353706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d108-1fde-4f75-b51b-1e291056b0d6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.388203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 43/86] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:34.388895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.400441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.401096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.401369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.401648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.403176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.404703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.406020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.406391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 44/87] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.407671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.529335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96887-0588-40a7-98bc-36f95161dece None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.532195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.540357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7283-7863-4b0f-a079-cca05eb7365a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.576404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.577140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.577817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.578175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.582919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.584186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.584671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.585123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.586511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.588174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.591065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 45/88] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.592245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.661883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.664271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.686139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.718572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143235-a518-4ce4-8a61-6705229364b9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.761500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.763825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.763825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.763825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.765360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.767130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.769685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 46/89] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.770766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.793886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 44/90] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:34.795174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:34.802774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.900797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57f8-e028-4aaf-8f7f-914c2c3193ae None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.914974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a105d-9e69-4f52-af2a-b77db99164e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:34.930993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:34.948775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.950892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.951356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.951936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.953100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:34.953612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:34.954889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:34.955570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:34.955675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:34.955953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:34.956295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:34.963418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 47/91] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=2c8acee661db441aae043379c7020618 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:34.964469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:35.057180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.059281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.098375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:35.116726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b24b5-ef61-4ada-8088-96a5fec960e5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:35.167275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:35.168368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:35.168659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:35.168932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:35.169745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:35.170053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.171524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.192446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 48/92] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:35.193407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:35.258723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 45/93] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:35.264292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:35.297292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:35.346413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f2225-57d8-4ab3-9eec-ccf5058c1d60 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:35.404000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:35.405783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:35.405896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:35.406173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:35.408551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.410024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.414202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 49/94] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:35 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:35.429211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:35.484714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:35.490289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a398-31f5-4ed5-a6e2-8fab767ef3c4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:35.559440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:35.560413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:35.560692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:35.560963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] PATH_INFO: `/v3/projects/ec570f1faf3441579230dcf65f9ae0cc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:35.567167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] RBAC: Authorizing `identity:get_project(project_id=ec570f1faf3441579230dcf65f9ae0cc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.568653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.573558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 46/95] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:35 2022] GET /identity/v3/projects/ec570f1faf3441579230dcf65f9ae0cc => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:35.579546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:35.672988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695368d-5875-4934-944b-24694e8c6235 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:35.746199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:35.746882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:35.747167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:35.747443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:35.748274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=72bbdec94ebd4a7ead34c004dcfc40eb) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:35.748580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.750015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60b62-9cbb-4b3e-bc9c-98373eaae44b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.764899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 50/96] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:35 2022] GET /identity/v3/role_assignments?user.id=72bbdec94ebd4a7ead34c004dcfc40eb&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:35.776165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:35.807180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ce3f-c520-494f-ad6f-e726da783f1d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:35.853502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:35.854160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:35.854439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:35.854715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:35.856167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=ec570f1faf3441579230dcf65f9ae0cc, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:35.856484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:35.858023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fb7c-9c93-4711-b50c-a8d1d9254b27 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:35.868385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 47/97] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:35 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=ec570f1faf3441579230dcf65f9ae0cc&role.id=2c8acee661db441aae043379c7020618 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:36.760071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a281-37a8-4efd-9dd7-c53904c005fc None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:36.760549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a281-37a8-4efd-9dd7-c53904c005fc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:36.760549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a281-37a8-4efd-9dd7-c53904c005fc None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:36.762428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 51/98] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:36.767990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:36.768406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:36.768537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:36.796787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:36.798344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:36.882431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 48/99] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:36.917828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a281-37a8-4efd-9dd7-c53904c005fc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.046069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:37.066516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a281-37a8-4efd-9dd7-c53904c005fc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:37.121424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:37.122077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.122352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.122626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.138325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:37.143837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:37.144657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:37.145388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 52/100] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:37.152156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.236222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:37.257064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c282e-63c6-44e1-9c1e-4b6ed3bc62a8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:37.293218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:37.293840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.294113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.294378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.295094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:37.295391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:37.296842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:37.305079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 49/101] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:37.310717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.443145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e56e6-0052-4ff8-b636-f7bb97cbcce9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:37.486640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:37.487357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.487555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.487854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] PATH_INFO: `/v3/users/ba87e8fd10314af6ba45befda61c0657` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.503209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=ba87e8fd10314af6ba45befda61c0657)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:37.504793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d226b-adc9-4616-8dfc-3e9e872c2dc7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:37.506857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 53/102] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:37 2022] GET /identity/v3/users/ba87e8fd10314af6ba45befda61c0657 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:37.512663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.546087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee683-d5c2-450c-8dfd-0581ddf948d5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.546409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee683-d5c2-450c-8dfd-0581ddf948d5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.546683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee683-d5c2-450c-8dfd-0581ddf948d5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.548191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 54/103] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:37.553592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.554129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.554572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.563756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:37.583757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:37.585282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:37.621346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66430-35b7-42dc-bd55-7d87d55e90d6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:37.656340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:37.657264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:37.657673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:37.658064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:37.674455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:37.738460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 55/104] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:37.755366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:37.757263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:37.777972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.885522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 50/105] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:37.892704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:37.939005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:37.985756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0511-c3e6-4df0-82ba-0da6b6a7bda3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.007698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f20af-a398-4952-89bb-e40cbc43f5d9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.051887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:38.053538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.054016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.054475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.055960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:38.057779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:38.060696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 51/106] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:37 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:38.069209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:38.092055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:38.112559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:38.113227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.113503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.113776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.115082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:38.116543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fb9f6-e874-4d41-9136-606dcd8e929c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:38.121319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 56/107] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:38.122544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136d49-a98c-4bd1-acb6-cf04b3cee514 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.122822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136d49-a98c-4bd1-acb6-cf04b3cee514 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.123092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136d49-a98c-4bd1-acb6-cf04b3cee514 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.126159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 57/108] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:38.134356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3136d49-a98c-4bd1-acb6-cf04b3cee514 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:38.243686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d316d-11d4-43b6-83c6-997834217929 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.252315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:38.282932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:38.283754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.285134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.285507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.290943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=ba87e8fd10314af6ba45befda61c0657) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:38.291261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:38.293314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34c5dd-d3ad-4dc8-a15d-0b6d8b0bcfa3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:38.304637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 52/109] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:38 2022] GET /identity/v3/role_assignments?user.id=ba87e8fd10314af6ba45befda61c0657&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:38.306840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c3d5-d455-4aef-a5ef-ae92bdc2d20c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.307126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c3d5-d455-4aef-a5ef-ae92bdc2d20c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.307398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c3d5-d455-4aef-a5ef-ae92bdc2d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.342620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3136d49-a98c-4bd1-acb6-cf04b3cee514 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.344809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0fe9c3d5-d455-4aef-a5ef-ae92bdc2d20c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:38.346390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0fe9c3d5-d455-4aef-a5ef-ae92bdc2d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:38.435253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:38.435933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.436217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.436490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.437193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:38.438660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:38.510031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 58/110] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:50:38 2022] POST /identity/v3/projects => generated 302 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:38.510813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 53/111] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:38.549688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:38.592518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4002c-9c62-42dd-9460-0ad2233a19ab None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.592838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4002c-9c62-42dd-9460-0ad2233a19ab None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.593082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4002c-9c62-42dd-9460-0ad2233a19ab None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.594532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 54/112] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:38.602236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42f51-78a8-49e8-a1e7-e457e8073f24 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.602512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42f51-78a8-49e8-a1e7-e457e8073f24 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.603108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42f51-78a8-49e8-a1e7-e457e8073f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.628609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f3c42f51-78a8-49e8-a1e7-e457e8073f24 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:38.630662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f3c42f51-78a8-49e8-a1e7-e457e8073f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:38.633632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:38.729227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 55/113] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:38.735803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0b7a-3a9e-4290-a315-501e52fc9434 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.736754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0b7a-3a9e-4290-a315-501e52fc9434 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.737255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0b7a-3a9e-4290-a315-501e52fc9434 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.739150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 56/114] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:38.747213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.747823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.748348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.769170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1a12-0d71-4b57-876b-506b1c3a0e3f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.773559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:38.775029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:38.811823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:38.814218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:38.815547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:38.816237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:38.816749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:38.833167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:38.840805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:38.841821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:38.842626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:38.845252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 59/115] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:38.846334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:38.874052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 57/116] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:38.875266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:38.965710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917bb4-830c-4384-bcb0-015166cf0cb8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:38.980462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.005841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.006866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.007284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.007691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.010929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857376-6a78-447d-935c-ebbfd3fd443e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.020536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:39.026182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:39.027647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:39.029230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:39.032571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 60/117] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:39.033577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.057259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.058002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.059018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.059571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.060814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:39.060919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.062488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.072132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 58/118] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.072879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.109645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.159718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801d76-7449-49d1-90b3-2903d2f86902 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.196359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.197005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.197108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1321e95-72f0-4313-a31f-8477ef37e957 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.197271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.197543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.208749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:39.215334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:39.216310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:39.217123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 61/119] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:39.217721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.242095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.242728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.243016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.243292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.244058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:39.244367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.246637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8d184-0092-48d4-b6b3-f91236a3d720 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.253993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.256883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 59/120] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.258097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563f10-7920-4413-8b0a-6376231f9321 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.258392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563f10-7920-4413-8b0a-6376231f9321 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.258666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563f10-7920-4413-8b0a-6376231f9321 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.265065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 60/121] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:39.269202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563f10-7920-4413-8b0a-6376231f9321 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.342405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64135aa-57ea-47de-b205-94e46d55fff0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.358195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.379896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563f10-7920-4413-8b0a-6376231f9321 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.392856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.393516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.393802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.394081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.395289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.396769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.398541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 62/122] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.399146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.419597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.428693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.429204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.429694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.430634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:39.431138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.432938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a186-a66f-4fca-90ae-f511f0605e96 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.442945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 61/123] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.444463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.444975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.445470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.464053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:39.465637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:39.511957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cc9d-bce6-4660-af21-2923542919ba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.515659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.543565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 62/124] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:39.544748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.556084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.556782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.557159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.557506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.559165 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.560808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.562714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 63/125] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.563401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.629809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.655182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60745629-1e7b-4330-9521-42f4e01e187e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.678561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50705a-5402-4584-bf5e-d04385070025 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.692614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.693537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.693998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.694484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.695868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.697608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.700294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 63/126] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.701273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.722540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.723237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.723517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.723828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.725184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.726620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.728471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 64/127] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.734160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.782331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.818268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1a26-84bb-4c6e-b5ba-1dc76e2d01c1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.856479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.857567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.858079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.858540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.859933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:39.861801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:39.863909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 64/128] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:39.864604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.867853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e87887-d152-476a-a466-6e80d724ae2c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:39.881197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:39.915152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:39.915932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:39.916221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:39.916496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:39.927809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:39.934039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:39.934914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:39.935692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 65/129] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:39.936873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:39.975616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5dadc-1543-45a9-8b23-279a28f0acf5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.013421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.014197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.014365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.014743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/6c7702e037e4487b83ac077b5c7f1b86/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.016966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, user_id=6c7702e037e4487b83ac077b5c7f1b86, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.018442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.037618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 65/130] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:39 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/6c7702e037e4487b83ac077b5c7f1b86/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:40.038683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:40.056824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:40.067527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4512b6-9b53-4a8b-b1f8-eb0f7f906814 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.134553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:40.138075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.138743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.139026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.139304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.145069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.147446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.149410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 66/131] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:39 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:40.156684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:40.173848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ab0b-5d8d-4709-8de0-087027012d6e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.218139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.219141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.219567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.220022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/72bbdec94ebd4a7ead34c004dcfc40eb/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.223091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, user_id=72bbdec94ebd4a7ead34c004dcfc40eb, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.224827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.241327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 66/132] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:40 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/72bbdec94ebd4a7ead34c004dcfc40eb/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:40.242392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:40.372716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51fb2a-790c-4fe3-810f-c947750d4291 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.382658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97650215-cad7-4894-b558-5c298a8a15c8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.437191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:40.443654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.444389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.444673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.444954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/6c7702e037e4487b83ac077b5c7f1b86/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.451055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, user_id=6c7702e037e4487b83ac077b5c7f1b86, role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.453092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.471511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 67/133] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:40 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/6c7702e037e4487b83ac077b5c7f1b86/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:40.474071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.474713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.474997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.475272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.479174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:40.479174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.479728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.493079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 67/134] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:40.499292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:40.620066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62d8c-9b9d-4f93-b5f6-68edf1fdf846 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.661520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.662280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.662625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.663228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.664556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.666131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.668854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 68/135] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:40 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:40.677176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:40.748424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:40.876662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e461c-eadb-4ea2-bc4d-632e2fc78420 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:40.931448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:40.932139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:40.932425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:40.932702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] PATH_INFO: `/v3/projects/ec570f1faf3441579230dcf65f9ae0cc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:40.940714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=ec570f1faf3441579230dcf65f9ae0cc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:40.942205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2097c-74ce-4cc6-9700-a040699c0ea3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:40.944419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 68/136] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:40 2022] GET /identity/v3/projects/ec570f1faf3441579230dcf65f9ae0cc => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:40.951370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:41.055365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:41.086825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328eae-8609-496c-8812-f8e6894cd5fc None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.089097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328eae-8609-496c-8812-f8e6894cd5fc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.089097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328eae-8609-496c-8812-f8e6894cd5fc None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.093720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 69/137] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:41.101168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3251cc-8a31-4248-9598-29a6ae0eb4f3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.101612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3251cc-8a31-4248-9598-29a6ae0eb4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.101894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3251cc-8a31-4248-9598-29a6ae0eb4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.140864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ea3251cc-8a31-4248-9598-29a6ae0eb4f3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:41.142170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea3251cc-8a31-4248-9598-29a6ae0eb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:41.153629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4ba4-2baa-42a0-b5f0-dbe9e3c964a2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:41.269264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:41.269966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.270247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.270522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] PATH_INFO: `/v3/projects/ec570f1faf3441579230dcf65f9ae0cc/users/6c7702e037e4487b83ac077b5c7f1b86/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.279460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec570f1faf3441579230dcf65f9ae0cc, user_id=6c7702e037e4487b83ac077b5c7f1b86, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:41.281019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200fd6-45dc-42c9-838e-4355f00cb6c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:41.322162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 69/138] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:40 2022] PUT /identity/v3/projects/ec570f1faf3441579230dcf65f9ae0cc/users/6c7702e037e4487b83ac077b5c7f1b86/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:41.334433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 70/139] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:41.341372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb725-eafb-4118-8382-f4d2224dc7ee None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.341771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb725-eafb-4118-8382-f4d2224dc7ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.342049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb725-eafb-4118-8382-f4d2224dc7ee None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.343721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 70/140] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:41.349538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.349910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.350435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.378658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeb725-eafb-4118-8382-f4d2224dc7ee None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:41.384664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:41.385897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:41.432215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:41.527151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 71/141] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:41.586559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:41.665219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeb725-eafb-4118-8382-f4d2224dc7ee None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:41.708102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:41.744888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aadf1-8c73-4555-a8f3-2e60ea06db96 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:41.749782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:41.751282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.752516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.754599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.787003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:41.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:41.796916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:41.798458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:41.802990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 71/142] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:41.819667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:41.820342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:41.821010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:41.821290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:41.821566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:41.827077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:41.828959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:41.830992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 72/143] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:41.836762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:41.869384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:41.973254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783551-983b-4320-a6b1-d4433d73d112 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:42.027229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824688b2-5ccc-4b61-89e8-b448ca778c49 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:42.050664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:42.051296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:42.051570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:42.051876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:42.052592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:42.052887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:42.054247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:42.080411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 72/144] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:42.085400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:42.100350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:42.100946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:42.101234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:42.105456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:42.105456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:42.107955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:42.161377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 73/145] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:41 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:50:42.190511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:42.283060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6a52-d940-4269-8592-ee2fb435dd7e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:42.326041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:42.327077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:42.327597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:42.328102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] PATH_INFO: `/v3/users/ba87e8fd10314af6ba45befda61c0657` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:42.329650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] RBAC: Authorizing `identity:get_user(user_id=ba87e8fd10314af6ba45befda61c0657)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:42.331332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:42.333364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 73/146] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:42 2022] GET /identity/v3/users/ba87e8fd10314af6ba45befda61c0657 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:42.340187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:42.495418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:42.535682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012756a5-e225-4feb-8d59-7120bd27d0df None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:42.587018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:42.587686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:42.588043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:42.588326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:42.589562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:42.590994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02012cf-fbdc-47f1-b90a-f9975d990b66 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:42.592993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 74/147] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:42 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:42.598570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:42.725377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4e8f-c4f8-4a7a-9832-7e16675552fb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:42.737738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:42.777033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:42.778125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:42.778608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:42.779088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/ba87e8fd10314af6ba45befda61c0657/roles/f291718185ed4de49bf39a3eb44da9a5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:42.781434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, user_id=ba87e8fd10314af6ba45befda61c0657, role_id=f291718185ed4de49bf39a3eb44da9a5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:42.783121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e451a4-737b-45a8-8f84-a156ba2fe018 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:42.797864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 74/148] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:42 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/users/ba87e8fd10314af6ba45befda61c0657/roles/f291718185ed4de49bf39a3eb44da9a5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:43.434242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330eea-2316-49d3-a886-c6af7574d263 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.435328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330eea-2316-49d3-a886-c6af7574d263 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.435890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330eea-2316-49d3-a886-c6af7574d263 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.437967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 75/149] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:43.443954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.444845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.445330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.473396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:43.475654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:43.564962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778f6b-6a47-4b71-9e8d-5a7d6d1a09f8 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.565584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778f6b-6a47-4b71-9e8d-5a7d6d1a09f8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.566098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778f6b-6a47-4b71-9e8d-5a7d6d1a09f8 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.567662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 76/150] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:43.573272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281099-b3e5-4a4d-afb6-f51d0bd9df1a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.574572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281099-b3e5-4a4d-afb6-f51d0bd9df1a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.575110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281099-b3e5-4a4d-afb6-f51d0bd9df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.586400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 75/151] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:43.601539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cc281099-b3e5-4a4d-afb6-f51d0bd9df1a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:43.602789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cc281099-b3e5-4a4d-afb6-f51d0bd9df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:43.624272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:43.747271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 77/152] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:43.749542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd984a3-b904-4507-b97a-97489407780c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.749542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd984a3-b904-4507-b97a-97489407780c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.749766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd984a3-b904-4507-b97a-97489407780c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.751127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 78/153] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:43.756820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.757111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.757386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.770191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:43.774388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf489-6728-4701-a895-0c76a8f10fa8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:43.777041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:43.778811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:43.818112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:43.819274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:43.819720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:43.820191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:43.832541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:43.838053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:43.839557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:43.840516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:43.842848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 76/154] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:43.844819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:43.861606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 79/155] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:43.868932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:43.878154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:43.986921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58929-c326-4721-bda9-714fb4ffe6dc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.051064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5380b-9ce1-4914-b4ed-8dd4b0fdc164 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.056328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.056981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.057257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.057598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.082200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:44.091992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:44.092865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 77/156] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:44.094415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:44.127223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.127907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.128188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.128463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.129190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:44.129494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:44.130873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:44.150108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:44.155628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 80/157] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:44.155628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:44.296166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:44.312096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0d05-9fae-4836-971b-3409825a9618 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.393328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614776-78e4-4194-a88d-dd3a7878a504 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.407938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.416158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.419630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.420872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.466153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:44.477005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:44.478343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:44.479110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:44.480364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 78/158] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:44.490646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:44.524580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.525329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.525483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.531808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.531808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:44.531808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:44.532962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:44.550979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 81/159] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:44.551867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:44.733610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:44.773712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd444d-687d-4799-a84a-7daac755674e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.817285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006a43-c100-4f2b-9a4c-916416bd0f55 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:44.840247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.840946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.841218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.841489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.842703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:44.845503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:44.847186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 79/160] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:44.848102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:44.882991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:44.905076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:44.906265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:44.906739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:44.907200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:44.908151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:44.908644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:44.910224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:44.927369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 82/161] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:44.928795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:45.071826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8a08b-3e64-444f-acf2-fc1b6c41493a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:45.124261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67204591-0611-48dc-bb8e-1e65bca444c5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:45.127811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:45.128557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:45.128834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:45.129104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:45.130284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:45.131734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:45.133481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 80/162] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:45.134250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:45.163147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:45.204553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:45.205222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:45.205481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:45.205752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:45.280943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806fc9-515d-4c4c-a335-417930b9aa9f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:45.328285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:45.340921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:45.341579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:45.341855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:45.342125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] PATH_INFO: `/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:45.343315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=72bbdec94ebd4a7ead34c004dcfc40eb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:45.347813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:45.352519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 81/163] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:45 2022] GET /identity/v3/users/72bbdec94ebd4a7ead34c004dcfc40eb => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:45.353759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:45.354591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:45.356756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:45.513696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 83/164] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:45.515574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:45.551299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:45.587470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfd4-8125-4eaf-a2f2-b1db61dfb2f9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:45.663003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:45.664019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:45.664766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:45.666124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:45.688159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:45.705298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6372ef-3b2a-4361-9ec3-2a8fc448f7fd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:45.787524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:45.788462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:45.788913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:45.789381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:45.834028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:45.836539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:45.953219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:45.955166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4524475-00da-4bd4-9305-cccb89befb6e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.007686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:46.051250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 82/165] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:46.052117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.146980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:46.165304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 84/166] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:46.167152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d54d4-2398-4fe8-a948-0e47059f23f9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.167625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d54d4-2398-4fe8-a948-0e47059f23f9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.168127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d54d4-2398-4fe8-a948-0e47059f23f9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.169701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 85/167] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:46.174704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d54d4-2398-4fe8-a948-0e47059f23f9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.309808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98f323-35a7-41e0-9252-80dee4c4bac1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:46.392849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:46.393854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d54d4-2398-4fe8-a948-0e47059f23f9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:46.393966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.394440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.394789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.400116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:46.402630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.410048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 83/168] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:46.410776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.449472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:46.451172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.451867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.455103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.456752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:46.458409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f99a-fb12-4ffe-8114-686b636c403f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.461845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 86/169] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:46.463390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.465689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.466987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.502973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:46.505577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:46.529259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:46.630396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2a2cf-b712-42a6-b002-14e462938257 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:46.643899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:46.669282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 87/170] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:46.671206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.675112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:46.676388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.676970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.677456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.678841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:46.680870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.689079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 84/171] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:46.690710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.843096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4f7a-79e1-4b17-b76c-ebca35cc90be None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:46.857753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec98-5159-4399-86b2-92f2ea413d39 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:46.885116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:46.886366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:46.887355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.888055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.888600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.889604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:46.890767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:46.893247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.900992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 88/172] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=2c8acee661db441aae043379c7020618 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:46.901991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:46.903457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:46.904331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:46.904989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:46.906401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:46.907445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:46.907915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:46.909696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:46.919044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 85/173] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:46.920354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.024976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.084756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309585-cbad-414a-ac91-07e39f02cbcb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.089856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afaa5f-64b1-4d70-9f91-6e82bc9c9c6c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.138455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c0d34-b6db-4274-800b-038994531895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.138985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c0d34-b6db-4274-800b-038994531895 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.139259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c0d34-b6db-4274-800b-038994531895 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.139528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c0d34-b6db-4274-800b-038994531895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.140615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c0d34-b6db-4274-800b-038994531895 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=72bbdec94ebd4a7ead34c004dcfc40eb) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:47.141028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c0d34-b6db-4274-800b-038994531895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:47.142455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c0d34-b6db-4274-800b-038994531895 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:47.142655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.143317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.143596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.143980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.150018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 89/174] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/role_assignments?user.id=72bbdec94ebd4a7ead34c004dcfc40eb&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:47.151639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679b66-1869-45c9-ac53-7ed01571b75c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.152113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679b66-1869-45c9-ac53-7ed01571b75c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.152525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679b66-1869-45c9-ac53-7ed01571b75c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.153930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 90/175] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:47.155172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f0d06-377c-47f0-ae20-5ec17d0de3fe None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.155634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f0d06-377c-47f0-ae20-5ec17d0de3fe None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.156112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f0d06-377c-47f0-ae20-5ec17d0de3fe None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.157734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 91/176] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:47.159039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2118-8ed8-4b7f-98e9-3fef70432255 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.159528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2118-8ed8-4b7f-98e9-3fef70432255 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.161276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:47.164205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2118-8ed8-4b7f-98e9-3fef70432255 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.165696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 92/177] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:47.167133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314c48-ea2d-4beb-91fa-32c57793174b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.167572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314c48-ea2d-4beb-91fa-32c57793174b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.168064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314c48-ea2d-4beb-91fa-32c57793174b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.169591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 93/178] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-25dcacc3-3a1d-4e75-bc7e-2796ae783bc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:47.170309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:47.171338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:47.172370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:47.173812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 86/179] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:47.174250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26074d-1541-4ccc-8676-12f8ccaff467 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.174723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26074d-1541-4ccc-8676-12f8ccaff467 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.175002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26074d-1541-4ccc-8676-12f8ccaff467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.176991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691936a-81f1-428d-812d-a3b04b6eeace None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.177482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691936a-81f1-428d-812d-a3b04b6eeace None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.178225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691936a-81f1-428d-812d-a3b04b6eeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.200390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7691936a-81f1-428d-812d-a3b04b6eeace None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:47.201644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7691936a-81f1-428d-812d-a3b04b6eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:47.202226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cf26074d-1541-4ccc-8676-12f8ccaff467 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:47.203565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cf26074d-1541-4ccc-8676-12f8ccaff467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:47.266245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.286719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 94/180] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:47.288336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.288580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.288846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.310186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 87/181] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:47.316057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:47.316057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:47.317736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.318185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.318463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.337874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:47.340307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:47.367343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.396172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 95/182] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:47.397587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.434966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 88/183] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:47.435769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.514781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62404b6d-eeb8-4c6f-83c7-3fc5354d12e6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.547976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.548594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.548867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.549132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.549835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:47.550130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:47.551207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe20f60-9fce-49a5-85c2-066d97d2075f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.551482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:47.554312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.560995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 96/184] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:47.561809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.586601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.587239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.587515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.587802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.598639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:47.603615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:47.605744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:47.608339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:47.609492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.609618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 89/185] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:47.609618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.668669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091f6d-c37f-4934-bbf0-fb417d72b037 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.702742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.703294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.703573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.703871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.709387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa683-64c7-47cb-850d-3a04247684e9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.714515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:47.719971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:47.720849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:47.721627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 97/186] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:47.722273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.745871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.746535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.746810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.747072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.757283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:47.762691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:47.763547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:47.764393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 90/187] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:47.765786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.791037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.822987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:47.826063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4925b9-8b76-43c7-86bb-1bf7fc702ef6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.860427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.861050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.861325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.861594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.862736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:47.864218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:47.865796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 98/188] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:47.866546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.867417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fd4a9-8184-484a-9f15-9f3c59c2afaf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.902154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:47.902783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:47.903059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:47.903331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] PATH_INFO: `/v3/users/6c7702e037e4487b83ac077b5c7f1b86` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:47.904523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] RBAC: Authorizing `identity:get_user(user_id=6c7702e037e4487b83ac077b5c7f1b86)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:47.905960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:47.907562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 91/189] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/users/6c7702e037e4487b83ac077b5c7f1b86 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:47.908428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:47.970509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5efb-a8db-4fe4-ab72-bd2e4ff9a911 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:47.999094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.003691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.004388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.004664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.004934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.005651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:48.005959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.007363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.007883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6b71-3d6a-49ae-b334-6bbbc315e9ca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.015970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 99/190] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.016765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.043878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.044498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.045046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.045762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:48.046176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.047427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.048281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.055809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 92/191] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.056586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.120921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c272a1-5995-4d99-924a-651459d56c83 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.154944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.155568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.155873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.156150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.156866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:48.157167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.158553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.160831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fdfc6-a535-4194-9024-0d7b90863488 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.167823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 100/192] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.169691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.196210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.196834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.197109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.197376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.198466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.200053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.239900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 93/193] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:48 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:48.239900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.243098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.293260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.303660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0647-6da5-44e1-9eb2-7672e9e6186e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.340991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.341633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.341909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.342178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.349943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cb0dd-0589-4518-8d1c-500e23f902cc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.389332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.390070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.390366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.390641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] PATH_INFO: `/v3/users/ba87e8fd10314af6ba45befda61c0657` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.392451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ba87e8fd10314af6ba45befda61c0657)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.393691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.400193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 94/194] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/users/ba87e8fd10314af6ba45befda61c0657 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.400193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.431453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.431694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.498551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.525601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a752c1-3bee-44ca-b13e-e6ce6bf874f1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.554114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.565519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 101/195] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:48.566604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.582693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.583354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.583626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.584599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.608899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.612251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.614512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 95/196] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.615476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.704612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760c9c-1ea2-4365-a913-ba549bca6af8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.745733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.746454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.746735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.747007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.748288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.749790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.751350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 102/197] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.752136 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:48.763344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482619-421c-4a51-937a-d0c0c9ebcbf5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.808421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.809807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.810083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.810352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.815088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.824828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:48.869199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129b68-adf2-4e69-b280-62af9ecd523a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:48.910267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.912373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.913168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:48.914283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:48.914761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:48.916149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] PATH_INFO: `/v3/projects/ec570f1faf3441579230dcf65f9ae0cc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:48.917955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] RBAC: Authorizing `identity:get_project(project_id=ec570f1faf3441579230dcf65f9ae0cc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:48.919607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:48.922129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 103/198] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/projects/ec570f1faf3441579230dcf65f9ae0cc => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:48.923665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.051383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 96/199] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:49.051556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b9320-6550-4a93-86ff-85ab1c772498 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.052611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.082307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.092727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.093432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.093710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.093978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.102471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.180308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.182855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.183686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe110-37ba-4ee4-81cf-bbfe1bfca35b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.232240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.233002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.233641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.234247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.304572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 104/200] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:49.306225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.337747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.339640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.341110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.379246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.445460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92677-00f7-4cbc-a4c8-ac21a341559f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.453428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 97/201] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:49.454431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.485443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.486516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.486929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.487333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.488391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=ec570f1faf3441579230dcf65f9ae0cc, user.id=6c7702e037e4487b83ac077b5c7f1b86) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:49.488951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.490542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.498536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 105/202] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/role_assignments?user.id=6c7702e037e4487b83ac077b5c7f1b86&scope.project.id=ec570f1faf3441579230dcf65f9ae0cc&role.id=2c8acee661db441aae043379c7020618 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:49.499970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.571278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b870c7-68b3-44cf-8f1e-856406202510 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.610526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.611264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.611509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.611798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.613015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.614695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.615978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.619364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 98/203] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:49.620826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.624678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.627993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14b81-7348-41b6-833f-bbfc6aaed98a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.668677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.669822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.670298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.670786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.673084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.675203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.678074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 106/204] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:49.678691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.751494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342524b9-838e-4ad7-b1d0-d3922691e193 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.800149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.800791 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.801083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.801352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.802514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.806544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.806544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 99/205] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:49.806739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.892063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffef2c9-0365-4c52-a8e0-83138af42dba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:49.900716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:49.941513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:49.942187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:49.942536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:49.942817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:49.943586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075, user.id=ba87e8fd10314af6ba45befda61c0657) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:49.944110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:49.945656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:49.957801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 107/206] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/role_assignments?user.id=ba87e8fd10314af6ba45befda61c0657&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:49.958639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:49.969375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb0e4-58d3-4766-ab18-d298c4a31ba2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:50.004198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:50.029453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:50.030099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.030377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.030668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.031538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=3e6b6967b8c4467db35fcb83b8a58a7c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:50.031875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:50.033384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04dc86-8bd4-4b19-893e-780a07bffa0c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:50.047590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 100/207] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/role_assignments?user.id=3e6b6967b8c4467db35fcb83b8a58a7c&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:50.143274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d282e-927e-40c1-8474-49e1c6609bf0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:50.194831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:50.195477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.195756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.196054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.196865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=3e6b6967b8c4467db35fcb83b8a58a7c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:50.197173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:50.199596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7064917-1de1-4ae6-87ea-61e71a2291a7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:50.212486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 108/208] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:49 2022] GET /identity/v3/role_assignments?user.id=3e6b6967b8c4467db35fcb83b8a58a7c&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:50.524120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1623-d4eb-4e7c-b206-57ad033d3286 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.524449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1623-d4eb-4e7c-b206-57ad033d3286 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.524664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1623-d4eb-4e7c-b206-57ad033d3286 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.526571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 101/209] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:50.535494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcef62-9149-4df0-a4ed-b02620fa3732 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.535770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcef62-9149-4df0-a4ed-b02620fa3732 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.536074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcef62-9149-4df0-a4ed-b02620fa3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.556756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9afcef62-9149-4df0-a4ed-b02620fa3732 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:50.558520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9afcef62-9149-4df0-a4ed-b02620fa3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:50.639854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 109/210] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:50.664715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e1623-d4eb-4e7c-b206-57ad033d3286 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:50.780205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e1623-d4eb-4e7c-b206-57ad033d3286 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:50.821208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:50.821945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.822131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.822468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.825668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:50.834540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:50.839666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220819-24ee-4e7d-be4e-d252580c56d7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.839995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220819-24ee-4e7d-be4e-d252580c56d7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.840268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220819-24ee-4e7d-be4e-d252580c56d7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:50.841159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:50.841997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:50.842795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:50.843831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 110/211] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:50.843944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 102/212] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:50.847638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:50.848020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:50.848369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:50.850535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:50.871935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:50.873604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:50.896201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:50.961933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d79002-5998-4995-922f-87aab9054c1c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:50.972140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 111/213] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:50.989014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.003992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.004887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.005346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.005871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.006859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:51.007337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.008902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.018551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 103/214] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:51.024274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.087155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:51.099720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c13c84-e0ee-4160-8b29-19887884a40b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.133280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496851c0-6658-4e14-84d6-4735645f2033 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.138998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.139763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.140163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.140505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.141737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.143362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.149854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 112/215] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:51.151903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.172331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.173249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.173701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.174142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] PATH_INFO: `/v3/users/6fcd947115e14d54a169df3d58392451` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.180181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:51.190215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd947115e14d54a169df3d58392451)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.191970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.198938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 104/216] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:51 2022] GET /identity/v3/users/6fcd947115e14d54a169df3d58392451 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:51.199875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.265719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507c94-e91d-4a10-a883-6615b026e2fd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.306157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.307865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.308566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.309038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0588c78-baf3-480d-b2bb-f7f575b1ba19 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.309512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.310481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.312609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.333069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:51.344163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 113/217] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:51 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:50:51.368067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.368817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.369097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.369478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.464044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.465682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.581068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 105/218] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:51.586678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.667481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:51.705279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ce11-8426-47ad-8baf-bda1797c2511 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.747363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.748050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.748335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.748610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.749804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.751233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27efa9-c804-413f-9f3e-0a308b067d70 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.753287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 114/219] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:51 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:51.759183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:51.787053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:51.889201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b51b3-7421-46f7-8a19-50d6fd8dc626 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:51.945822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:51.946368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:51.946649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:51.946920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:51.948107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=6fcd947115e14d54a169df3d58392451) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:51.948553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:51.950001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcd11-ae8e-47aa-9191-96f335758d7f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:51.962132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 106/220] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:51 2022] GET /identity/v3/role_assignments?user.id=6fcd947115e14d54a169df3d58392451&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=2c8acee661db441aae043379c7020618 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:52.400927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336ef6-05d0-4d4e-9f84-1eb180ee7d51 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.401893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336ef6-05d0-4d4e-9f84-1eb180ee7d51 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.402401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad336ef6-05d0-4d4e-9f84-1eb180ee7d51 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.404027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 115/221] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:52.409547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.410127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.410604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.437189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560998f-0317-4967-af20-65ea899cd680 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.437819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560998f-0317-4967-af20-65ea899cd680 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.438289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560998f-0317-4967-af20-65ea899cd680 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.439871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 116/222] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:50:52.441604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:52.443043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:52.444933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.445433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.445902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.476842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:52.478060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:52.565324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 107/223] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:52.575063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 117/224] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:52.589488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:52.610735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:52.627406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:52.748674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:52.778722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5d377-b1a3-4297-a8a8-f00fe736f34e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:52.802988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd191fd3-fd25-4a82-bde7-e67e8523f8e2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:52.835408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:52.837019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.838115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.838730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.852170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:52.853109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:52.855122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:52.858231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:52.860217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:52.866996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:52.868191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:52.869810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:52.875292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 108/225] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:52.881678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:52.884765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:52.898579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:52.899693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:52.900728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:52.903299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 118/226] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:52.925370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:52.992606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.027449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43168c-febb-4c16-bfeb-40951774c8cb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.065389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.066318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.066776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.067190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.068115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:53.068563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.070070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.080450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 109/227] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:53.092840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.121334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252a11-6f01-47f1-8f59-57a1d94b9ed0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.181551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.191123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.191819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.192106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.192378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.193102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:53.193402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.194767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.209147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 119/228] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:53.217630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.278948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9e3d-7231-4c11-89e5-9ba2b43c3a73 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.339481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.347496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.348523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.348980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.349452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.350825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.352533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.354597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 110/229] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:53 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:53.374172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.389590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec20a-400c-49a0-83ca-4907add5fd8c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.427217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.427971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.428184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.428458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.429751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.431321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.439818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 120/230] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:53 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:53.440166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.528162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79af3-0dae-4698-ab94-fb4e68e1ee63 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.565544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.566117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.566385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.566662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.567945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.568149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.569390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.575904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 111/231] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:53 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:53.577804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.650869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.674395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659634d-7b42-440b-ba0a-8b893c84acb8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.689459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23aa5d-3b09-4da6-bfc5-552c32562613 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.725405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.726466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.726952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.727443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/users/3e6b6967b8c4467db35fcb83b8a58a7c/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.730716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, user_id=3e6b6967b8c4467db35fcb83b8a58a7c, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.732456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.749659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 112/232] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:53 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/users/3e6b6967b8c4467db35fcb83b8a58a7c/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:50:53.762312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.763240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.763719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.764235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.765655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:53.767358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1579d-88a5-4e1f-a67a-55ccba94d4e5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:53.769321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 121/233] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:53 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:53.775835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:53.893378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd935-7488-478e-81fc-a472be77fcea None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.893672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd935-7488-478e-81fc-a472be77fcea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.893837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd935-7488-478e-81fc-a472be77fcea None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.895199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 122/234] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:53.900292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa49-fe6f-40cb-9c3d-719b643158b1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.900455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa49-fe6f-40cb-9c3d-719b643158b1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.900613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fa49-fe6f-40cb-9c3d-719b643158b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.918760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6385-6f93-49a8-a202-3eb8a2239aff None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:53.923539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8297fa49-fe6f-40cb-9c3d-719b643158b1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:53.924813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8297fa49-fe6f-40cb-9c3d-719b643158b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:53.984710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:53.995143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:53.995932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:53.996187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:53.996460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/users/3e6b6967b8c4467db35fcb83b8a58a7c/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:53.998801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, user_id=3e6b6967b8c4467db35fcb83b8a58a7c, role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:54.000412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:54.020376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 113/235] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:53 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/users/3e6b6967b8c4467db35fcb83b8a58a7c/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:54.053685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 123/236] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:54.079814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.203121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d4bc-28f4-4327-92a1-0318b8ecfe89 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.248320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.249041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.249320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.249593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.267409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:54.271144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e11b-aba9-4c4f-8ccd-1b79be267813 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.271435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e11b-aba9-4c4f-8ccd-1b79be267813 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.271715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e11b-aba9-4c4f-8ccd-1b79be267813 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:54.273065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:54.274162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:54.276153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:54.276774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 124/237] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:54.276842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 114/238] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:54.279950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.280468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.280960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.294994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.310878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:54.315650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:54.400248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:54.431943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:54.460184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 125/239] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:54.485942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7d80-132c-4b02-93ac-25f35f8d5419 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.513667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.554098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.554968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.555340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.555716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.557243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:54.557651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:54.559135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004ca5c-05d9-41e0-b3d7-2bbd9a65311c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:54.573053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 115/240] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:54.574564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762984-8af4-40ae-b556-236b3964585b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.574975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762984-8af4-40ae-b556-236b3964585b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.575355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762984-8af4-40ae-b556-236b3964585b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.576989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 116/241] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:54.578030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1762984-8af4-40ae-b556-236b3964585b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.636034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d81b-0aa6-4fe8-b8f3-c55d05f866d4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.681886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.683029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.683445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.684154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.685869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:54.687465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbb189-9e37-437b-85d5-8c76693359c9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:54.690336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 126/242] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:54.691590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.692051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.692444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.708978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1762984-8af4-40ae-b556-236b3964585b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.717476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:54.718877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:54.726015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:54.753657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.754198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.754582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.755054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] PATH_INFO: `/v3/users/ba18eb436c064ba2a259fe4156afbb22` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.778728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] RBAC: Authorizing `identity:get_user(user_id=ba18eb436c064ba2a259fe4156afbb22)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:54.781157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:54.784150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 117/243] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/users/ba18eb436c064ba2a259fe4156afbb22 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:54.785187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.788446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:54.815739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 127/244] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:54.816938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:54.905729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f9c3-82c6-4e3d-9d72-0a95e42ae339 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.922178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc093f0-33f1-4d2e-9518-1bb0a7234579 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:54.944871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.945640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.945988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.946338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.947324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:54.949034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:54.958963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:54.959921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:54.960391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:54.960849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:54.973416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 118/245] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:54 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:54.980994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.026028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:55.034419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:55.043969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.045637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.164829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 128/246] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:55.176279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.182761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd256-6528-48ce-ac02-99af9ec21eca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.233874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.235489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.235767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.236067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.249964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:55.255733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:55.256717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:55.258185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 119/247] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:55.265605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.348842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:55.369546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747266af-8c8d-4c4a-8836-4bafb7ef5990 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.381801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:55.404373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b93a49-e2d5-4ea2-9e5f-a7b2a391175a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.419138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.419138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.419138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.419138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.420616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.422137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.425458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 129/248] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:55 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:55.432597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.472992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.473972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.474447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.474934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.475900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:55.476402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.477969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.488770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 120/249] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:55.493759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.566931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5de598-747c-4c6f-8d6a-b273fff1cb6c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.615685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.615685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.615685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.615685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.616105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=ba18eb436c064ba2a259fe4156afbb22) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:55.616105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.616956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.628685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 130/250] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:55 2022] GET /identity/v3/role_assignments?user.id=ba18eb436c064ba2a259fe4156afbb22&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:55.643276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11440-bab1-46ef-8514-239ac0df32b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.687756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.688460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.688733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.689062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] PATH_INFO: `/v3/users/6fcd947115e14d54a169df3d58392451` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.690308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd947115e14d54a169df3d58392451)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.691805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.693810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 121/251] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:55 2022] GET /identity/v3/users/6fcd947115e14d54a169df3d58392451 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:55.699982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.734281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:55.841802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0320eec-c774-45b1-b47f-96d7acccb992 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:55.887398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:55.888105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:55.888386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:55.888659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:55.889973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:55.891418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f907b0-eceb-4beb-8deb-a7986a4a829e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:55.893354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 131/252] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:55 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:55.899009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:55.931763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:56.068799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964c6d-8436-4084-bf10-c4d456d31c19 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:56.119360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:56.120507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.120991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.121457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/users/6fcd947115e14d54a169df3d58392451/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.129148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, user_id=6fcd947115e14d54a169df3d58392451, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:56.130920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec1c17-f25a-47e6-bd55-9d8b0f5bf5e9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:56.149051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 122/253] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:50:55 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/users/6fcd947115e14d54a169df3d58392451/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:50:56.317406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7cf8d-00fd-4fe4-a16b-bcf648da07f4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.317770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7cf8d-00fd-4fe4-a16b-bcf648da07f4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.317970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7cf8d-00fd-4fe4-a16b-bcf648da07f4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.319328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 132/254] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:56.325728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c5d1-8cc8-486b-8900-ec107ccd69f1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.326407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c5d1-8cc8-486b-8900-ec107ccd69f1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.326880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c5d1-8cc8-486b-8900-ec107ccd69f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.352843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0270c5d1-8cc8-486b-8900-ec107ccd69f1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:56.354668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0270c5d1-8cc8-486b-8900-ec107ccd69f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:56.462488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 123/255] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:56.487101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7cf8d-00fd-4fe4-a16b-bcf648da07f4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:56.596350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:56.618513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7cf8d-00fd-4fe4-a16b-bcf648da07f4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:56.625481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004a1-f54e-435e-ad72-f4f513c0ac13 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.626071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004a1-f54e-435e-ad72-f4f513c0ac13 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.626539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004a1-f54e-435e-ad72-f4f513c0ac13 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.628157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 124/256] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:56.633314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.633865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.634943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.652172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:56.668174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:56.669418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:56.706649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:56.707220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.707561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.707867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.734879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:56.740585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:56.741432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:56.742630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 133/257] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:50:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:56.751489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:56.777320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 125/258] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:56.804628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:56.925262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dd39e-21ac-43f6-aed1-73217082b4d2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:56.951316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae9b4-afe8-42b6-ab7b-1057d201fd05 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:56.974506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:56.975085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:56.975359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:56.975629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:56.980110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:56.998864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:57.004745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:57.005699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:57.006865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 126/259] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:50:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:57.012718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:57.049504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.050520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.051124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.051620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.052635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:57.053170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:57.054769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:57.076161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 134/260] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:57.089093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:57.120245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:57.138571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da7e-8868-41a5-b3d7-4e5aedde7484 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:57.189034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.189670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.189942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.190206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.190925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:57.191218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:57.192760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:57.207990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 127/261] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:57.215198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:57.320475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:57.411874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c52b-f2af-4a8f-8cc3-8628d647252f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:57.433155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774256-748a-4109-97e4-3de75b442ef8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:57.513551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.514206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.514477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.514743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.515955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:57.517388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:57.519072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.519608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 128/262] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:57 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:57.519808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.520096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.520432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] PATH_INFO: `/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.521709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6b6967b8c4467db35fcb83b8a58a7c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:57.523114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:57.524668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:57.529382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 135/263] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:57 2022] GET /identity/v3/users/3e6b6967b8c4467db35fcb83b8a58a7c => generated 283 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:57.535869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:57.724966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580723d-d20b-4b3d-afb3-c9b8371249b0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:57.755161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:57.772137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:57.799549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.800194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.800467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.800732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.821529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6586-f5b7-49c1-88b1-11debf5ef822 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:57.896972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:57.897594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:57.897866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:57.898132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:57.956472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:57.957958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.049222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:58.050601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.114682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 129/264] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:50:58.120704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:58.164178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:58.218477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:58.253617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 136/265] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:50:58.260554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:58.336555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64636-aec2-45de-be7f-611e83e91ff3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:58.382716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0dcb-01cc-4ffe-9e29-dcbdea68d2f3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:58.412168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:58.412927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.413207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.413479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.416284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:58.417852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.419651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 130/266] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:58 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:58.428643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:58.428993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:58.429529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.429992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.430420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.436529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:58.438008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.440049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 137/267] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:58 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:58.447462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:58.494923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:58.572905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca99c59-44eb-4cdb-8a3f-187960f5d3c2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:58.643895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:58.643895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.643895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.643895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.644318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=3e6b6967b8c4467db35fcb83b8a58a7c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:58.644318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:58.644959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb7e7-6dda-4562-b195-51f5bacf52a3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.651937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:58.654268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 138/268] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:58 2022] GET /identity/v3/role_assignments?user.id=3e6b6967b8c4467db35fcb83b8a58a7c&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:50:58.663806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1fef-e36d-4009-8b3d-8b3074ba7078 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.664785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1fef-e36d-4009-8b3d-8b3074ba7078 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.667472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1fef-e36d-4009-8b3d-8b3074ba7078 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.671387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 139/269] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:58.676640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c9ea-7e89-4835-9441-e04f6257f9ca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:58.695376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06aeb8-7717-41b7-ad97-7e82c43ea127 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.695954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06aeb8-7717-41b7-ad97-7e82c43ea127 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.696370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06aeb8-7717-41b7-ad97-7e82c43ea127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.733016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bf06aeb8-7717-41b7-ad97-7e82c43ea127 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:58.735914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bf06aeb8-7717-41b7-ad97-7e82c43ea127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:58.768968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:58.769841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.770260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.770695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.771647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=3e6b6967b8c4467db35fcb83b8a58a7c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:58.772161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:58.773987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152f1db-51a5-4dd1-9e0f-3d0acb7a65a9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:58.790841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 131/270] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:50:58 2022] GET /identity/v3/role_assignments?user.id=3e6b6967b8c4467db35fcb83b8a58a7c&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:58.795810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d063d-c340-4d1c-a769-d6394a3532dc None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.797489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d063d-c340-4d1c-a769-d6394a3532dc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.798094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d063d-c340-4d1c-a769-d6394a3532dc None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.806720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 132/271] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:58.809711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.810919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.811523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.835918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:58.838133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:58.918093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 140/272] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:50:58.919644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729019-2119-4542-baef-6f2aa1e4f49c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.920155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729019-2119-4542-baef-6f2aa1e4f49c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.920569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729019-2119-4542-baef-6f2aa1e4f49c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.927384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 141/273] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:58.932452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:58.932770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:58.933004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:58.941041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 133/274] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:58.960113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:58.961341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:58.970635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.005388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.059923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 142/275] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:59.061177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.096148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.122924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c56eb-5c28-44c2-a343-752db2834fd9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.177761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.178359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.178589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.178853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.198272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:59.203275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:59.204186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:59.210271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:59.210944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9277-517f-4684-b79b-ccf0c33317c3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.211015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 134/276] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:50:59.211015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.252042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.252686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.252960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.253263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.254374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.255845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.257428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 143/277] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:59.260763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.294959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.311279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16cb3-a5f1-4b7e-ba55-89ef2451dd98 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.346291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.346969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.347205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.347470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.357309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:59.358665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadf43e-de4a-4238-ba59-def001eab90c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9e437c66-b1cd-416c-9eca-4138a1acf980 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:59.368890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:59.370253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:50:59.371029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 135/278] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:59.371877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb50b5-bf7e-47d2-908d-a50a3339800d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.371877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb50b5-bf7e-47d2-908d-a50a3339800d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.371877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb50b5-bf7e-47d2-908d-a50a3339800d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.373289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 136/279] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:50:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:50:59.373653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb50b5-bf7e-47d2-908d-a50a3339800d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.383127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.399382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.400135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.400412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.400690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.401404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:59.401709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.403083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.411940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 144/280] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:59.412904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.483297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb50b5-bf7e-47d2-908d-a50a3339800d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.511980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.516052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ea37-cddb-4ffb-bb06-ba15a8228083 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.523948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.524829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.525306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.525623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.526307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.527748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9e6ee-72d7-47d7-bd62-bb9e4610a1ba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.548786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 137/281] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:50:59 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:50:59.549848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.550128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.550398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.559475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.560228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.560507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.560776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.561517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:50:59.561823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.563245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.574403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 145/282] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:59.575027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:50:59.575882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:50:59.580065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.640597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.653523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 138/283] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:50:59.654390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.714419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2869-fe36-4dc9-895e-d9ca47992ae1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.753657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.754234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.754520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.754788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] PATH_INFO: `/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.769577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e354c-882f-4c29-8fa2-ac506b32d0b9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.771744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] RBAC: Authorizing `identity:get_user(user_id=7ab36ea9f68644b0806934f8a0a5ccc7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.773260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.775043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 146/284] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:59.775981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.799406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.816614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.817278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.818343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.818343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] PATH_INFO: `/v3/users/ba18eb436c064ba2a259fe4156afbb22` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.819253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ba18eb436c064ba2a259fe4156afbb22)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:50:59.820831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:50:59.823447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 139/285] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/users/ba18eb436c064ba2a259fe4156afbb22 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:50:59.826313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.894979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:50:59.908139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d16d0-aecf-4116-9a67-a1c4ee3d21cb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.957140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.957346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd474-02d9-4ad3-bbcc-db152095a7b3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:50:59.957791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.958065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.958335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:50:59.972461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:50:59.978989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:50:59.979884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:50:59.980668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:50:59.981269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 147/286] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:50:59.981814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:50:59.998698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:50:59.999314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:50:59.999639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:50:59.999948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.000794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, user.id=7ab36ea9f68644b0806934f8a0a5ccc7, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:00.001100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.002715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.008659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 140/287] 10.222.0.95 () {56 vars in 1308 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/role_assignments?user.id=7ab36ea9f68644b0806934f8a0a5ccc7&scope.system=all&role.id=2c8acee661db441aae043379c7020618 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:00.009918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:00.086514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:00.113060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96088b2d-fa8a-4d7c-bcad-71917e45ccd4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:00.146665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7aa027-09ab-45eb-aba0-87ce57fec1fc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:00.155354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:00.156364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:00.156851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:00.157362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.158725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.160402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.162586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 148/288] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:50:59 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:00.169560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:00.183277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:00.196998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728221a-475b-4317-8592-d55142e09237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:00.198134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728221a-475b-4317-8592-d55142e09237 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:00.198625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728221a-475b-4317-8592-d55142e09237 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:00.199117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728221a-475b-4317-8592-d55142e09237 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.200110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728221a-475b-4317-8592-d55142e09237 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:00.200647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728221a-475b-4317-8592-d55142e09237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.202243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728221a-475b-4317-8592-d55142e09237 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.211536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 141/289] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:00.224948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728221a-475b-4317-8592-d55142e09237 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:00.315653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a49-d82f-4a42-aa11-0dfccbae49a2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:00.359510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:00.360293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:00.360568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:00.360840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/users/ba18eb436c064ba2a259fe4156afbb22/roles/f291718185ed4de49bf39a3eb44da9a5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.365747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, user_id=ba18eb436c064ba2a259fe4156afbb22, role_id=f291718185ed4de49bf39a3eb44da9a5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.367460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.401110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 149/290] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:00 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/users/ba18eb436c064ba2a259fe4156afbb22/roles/f291718185ed4de49bf39a3eb44da9a5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:51:00.419017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728221a-475b-4317-8592-d55142e09237 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:00.457599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:00.458251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:00.458528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:00.458808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] PATH_INFO: `/v3/users/6fcd947115e14d54a169df3d58392451` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.460074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd947115e14d54a169df3d58392451)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.461527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.464176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 142/291] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:00 2022] GET /identity/v3/users/6fcd947115e14d54a169df3d58392451 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:00.473219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:00.483428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:00.616565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02558495-8445-41ba-8933-36a4754b4393 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:00.659130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:00.659753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:00.660063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:00.660391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:00.764883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:00.766969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:00.779374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:00.913568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 150/292] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:00.918983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:00.998510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:01.047759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56087-8949-410f-9651-3f83332025b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:01.084227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:01.084958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:01.085241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:01.085513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:01.086758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:01.090146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb4137-b339-463f-85fd-173d238ab936 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:01.092469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 143/293] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:00 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:01.100953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:01.223838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de8ed-d64b-403f-9f57-48f9edb66027 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:01.232020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:01.270335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:01.270960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:01.271240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:01.271514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:01.272330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=6fcd947115e14d54a169df3d58392451) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:01.272640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:01.274075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96202e-134c-46cc-9c41-6150d1b071f3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:01.284277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 151/294] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:01 2022] GET /identity/v3/role_assignments?user.id=6fcd947115e14d54a169df3d58392451&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=2c8acee661db441aae043379c7020618 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:02.060786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e087262-4150-41e7-bf0c-103731f30a9d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.061316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e087262-4150-41e7-bf0c-103731f30a9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.061781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e087262-4150-41e7-bf0c-103731f30a9d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.064262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 144/295] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:02.070017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.070526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.070606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.090370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:02.091738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:02.092681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefab30-59e8-4177-939d-0669f9b8e84b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.092964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefab30-59e8-4177-939d-0669f9b8e84b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.093458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefab30-59e8-4177-939d-0669f9b8e84b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.095064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 145/296] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:02.100384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.100808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.101150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.120802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:02.122061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:02.171838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 152/297] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:02.187565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.199126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 146/298] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:02.222846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.293022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.298774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.302171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24c44f-a8f4-4bcd-af3f-ffd42cc10f2c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.346998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.348071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.348745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.349182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.351131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:02.354032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:02.357115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 153/299] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:02.362007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa7da-ea03-4c2e-8403-aed0f1be051a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.365443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.408076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.409053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.409479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.410432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.425477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:02.432426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:02.433509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:02.434377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:02.440184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 147/300] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:02.441452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.489282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a78dc-24bb-4284-9cb7-308a44e8c70a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.540135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.541340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.541866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.542346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] PATH_INFO: `/v3/groups` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.543340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:02.545257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa49391-5f14-429e-a13b-ec1ec77c770e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:02.549305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad70e-ec02-4540-886b-09dbf0d7b130 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.562674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 154/301] 10.222.0.95 () {60 vars in 1134 bytes} [Fri Aug 5 19:51:02 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:02.563957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8c01-d71a-4a30-a900-826dbdd9827b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.564247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8c01-d71a-4a30-a900-826dbdd9827b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.564522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8c01-d71a-4a30-a900-826dbdd9827b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.565904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 155/302] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:02.572243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.572526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.572805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.583343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.593791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:02.595064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:02.611646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.612229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.612761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.613045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.614334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:02.614638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:02.616718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:02.624752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.630072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 148/303] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:02.639057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.686472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 156/304] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:02.712255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.776955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643eaff-d5f2-4927-be14-e16f9b201723 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.824889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.825617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.825821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.826096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] PATH_INFO: `/v3/users/bf820ba19e7c494ebc59c0daea5410d2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.835208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f210e-b3dc-4dd1-9a20-a44b3b65ef15 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:02.843874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] RBAC: Authorizing `identity:get_user(user_id=bf820ba19e7c494ebc59c0daea5410d2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:02.845748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:02.852552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 149/305] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/users/bf820ba19e7c494ebc59c0daea5410d2 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:02.854278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.880854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:02.881441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:02.881957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:02.882301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:02.892228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.896516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:02.903926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:02.905346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:02.906145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:02.912276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 157/306] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:02.913938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:02.936570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:02.974397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bd1d0-50c4-49d8-bb7a-5708cf75dc25 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.010936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.011948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.012420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.012901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.013942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, user.id=bf820ba19e7c494ebc59c0daea5410d2, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:03.014522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.016279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80964fed-85d9-4ebf-89cc-d6322ab6761f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.021970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 150/307] 10.222.0.95 () {56 vars in 1308 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/role_assignments?user.id=bf820ba19e7c494ebc59c0daea5410d2&scope.system=all&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:03.026213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d905c8-745a-4040-b536-49fcf0532f06 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.033024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb304f-79a3-4f64-9ca2-84612f272e7c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.033357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb304f-79a3-4f64-9ca2-84612f272e7c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.033756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb304f-79a3-4f64-9ca2-84612f272e7c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.035467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 151/308] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:03.042160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.042466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.042714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.066526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:03.067141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.067266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.067556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.067771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.067877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:03.068526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:03.068827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.070205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.080163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 158/309] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:03.086206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.176360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 152/310] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:03.192205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:03.200346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.213872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625f6bb-47ec-4f1b-9c22-6f1c554fd457 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.233077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:03.250199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.250849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.251122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.251392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] PATH_INFO: `/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.252602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] RBAC: Authorizing `identity:get_user(user_id=7ab36ea9f68644b0806934f8a0a5ccc7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.254028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.255949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 159/311] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:03 2022] GET /identity/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:03.261526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.314094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7832fb-fc86-4fc5-bb11-021a13eb7a17 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.350765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.351411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.351692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.352041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.364041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:03.369680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:03.370721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:03.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:03.373784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ad66-b7fc-453b-8c8f-694e7c341486 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.375993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 153/312] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:03.376855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.411418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.412290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.412693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.413071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] PATH_INFO: `/v3/system/users/7ab36ea9f68644b0806934f8a0a5ccc7/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.415592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ab36ea9f68644b0806934f8a0a5ccc7, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.417261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.431505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 160/313] 10.222.0.95 () {58 vars in 1334 bytes} [Fri Aug 5 19:51:03 2022] PUT /identity/v3/system/users/7ab36ea9f68644b0806934f8a0a5ccc7/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:51:03.492173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:03.510576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb65a-cef3-474a-b654-70b2d113e1b4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.554609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.555257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.555803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.556137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.556899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:03.557202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.558599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.568719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 154/314] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:03.575963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.593305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:03.692053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b27d-c1f0-4aa6-a83f-4f0d693a33f5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.727991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.728636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.728912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.729179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] PATH_INFO: `/v3/users/ba18eb436c064ba2a259fe4156afbb22` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.730351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] RBAC: Authorizing `identity:get_user(user_id=ba18eb436c064ba2a259fe4156afbb22)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.731766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:03.733569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 161/315] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:03 2022] GET /identity/v3/users/ba18eb436c064ba2a259fe4156afbb22 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:03.739202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:03.847750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf83d99-f4d8-4611-b60d-6531c64d184b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:03.882893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:03.883689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:03.883998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:03.884256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:03.919803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:03.955528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:03.956916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:04.062273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 155/316] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:04.067693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:04.157726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:04.182582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cfd24-4529-4a31-a878-c963d6af230b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:04.220979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:04.221994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:04.222479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:04.222975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:04.224534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:04.226266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66279-257e-4aa8-899a-07bd17d2786e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:04.229695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 162/317] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:04 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:04.237305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:04.288194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:04.344260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b03e79-e56d-42d8-a93d-8c25314a692b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:04.382424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:04.383100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:04.384091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:04.384556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:04.385390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, scope.project.id=e18533b0d92a42b6885a2394664db9be, user.id=ba18eb436c064ba2a259fe4156afbb22) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:04.385746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:04.387161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50d2de-6ba0-41d9-86ac-198aa0d6ec8f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:04.397573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 156/318] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:04 2022] GET /identity/v3/role_assignments?user.id=ba18eb436c064ba2a259fe4156afbb22&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:04.734364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed1-5ed5-4885-8892-6180626f19e4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:04.734743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed1-5ed5-4885-8892-6180626f19e4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:04.734918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed1-5ed5-4885-8892-6180626f19e4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:04.736452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 163/319] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:04.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951911-5651-447d-8024-67740933a966 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:04.741718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951911-5651-447d-8024-67740933a966 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:04.741989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951911-5651-447d-8024-67740933a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:04.760941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-94951911-5651-447d-8024-67740933a966 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:04.762111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-94951911-5651-447d-8024-67740933a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:04.831022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 157/320] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:04.853333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8ed1-5ed5-4885-8892-6180626f19e4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:04.958648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8ed1-5ed5-4885-8892-6180626f19e4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:04.994675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:04.995264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:04.995543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:04.995838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:04.996980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:04.998419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be7b2f-7918-47be-b84b-8b6e922f5492 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:05.000254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 164/321] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:05.007767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951911-5651-447d-8024-67740933a966 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.053503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:05.116802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951911-5651-447d-8024-67740933a966 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:05.141587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7205-de76-4c12-879c-fd2cb72edf08 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.141865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7205-de76-4c12-879c-fd2cb72edf08 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.142168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7205-de76-4c12-879c-fd2cb72edf08 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.143463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 165/322] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:05.148399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.148698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.149536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.157395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:05.158027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.158305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.158577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] PATH_INFO: `/v3/groups` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.159237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:05.160954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:05.167302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:05.168705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:05.181153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 158/323] 10.222.0.95 () {60 vars in 1134 bytes} [Fri Aug 5 19:51:05 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:51:05.183330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:05.251911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 166/324] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:05.275772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.388826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6506f35-05a3-4be3-9306-fd2a05cc220c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:05.390685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:05.438352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:05.439004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.439280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.439548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.453625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:05.459100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:05.459997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:05.460758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 159/325] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:05.468030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.583404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbf45-f668-48ce-9f6f-81c5a8401ea8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:05.621472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:05.622102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.622371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.622637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.623350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:05.623643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:05.625096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6faef-b8c0-4a36-b866-988b39d15908 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:05.634865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 167/326] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:05.640822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.666377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42036d-8284-41db-843c-af9685745234 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.666699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42036d-8284-41db-843c-af9685745234 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.666931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42036d-8284-41db-843c-af9685745234 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.668334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 168/327] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:05.673615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.673891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.674161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.699226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:05.700927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:05.703146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:05.788715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409ea7-ce4e-483c-9753-2550084d9b85 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:05.795150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 169/328] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:05.825711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.835879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:05.836512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:05.836862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:05.837343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] PATH_INFO: `/v3/users/bf820ba19e7c494ebc59c0daea5410d2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:05.838633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] RBAC: Authorizing `identity:get_user(user_id=bf820ba19e7c494ebc59c0daea5410d2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:05.840114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:05.842137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 160/329] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:05 2022] GET /identity/v3/users/bf820ba19e7c494ebc59c0daea5410d2 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:05.850247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:05.886969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:05.961967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9fc3a-eb99-47d2-bc9c-7e11f8aedab8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:05.975878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22478899-6be4-4354-9ab2-9be69879b62b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:06.002030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:06.002802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:06.003145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:06.003491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] PATH_INFO: `/v3/system/users/bf820ba19e7c494ebc59c0daea5410d2/roles/f291718185ed4de49bf39a3eb44da9a5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:06.005264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf820ba19e7c494ebc59c0daea5410d2, role_id=f291718185ed4de49bf39a3eb44da9a5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:06.006758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:06.018860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 161/330] 10.222.0.95 () {58 vars in 1334 bytes} [Fri Aug 5 19:51:05 2022] PUT /identity/v3/system/users/bf820ba19e7c494ebc59c0daea5410d2/roles/f291718185ed4de49bf39a3eb44da9a5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:06.022788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:06.023512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:06.024389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:06.024731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:06.041846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:06.048893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:06.054145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:06.055676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:06.056655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 170/331] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:06.064237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:06.214567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:06.223059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6ee7-4d93-47f0-ad76-70b55aae12f1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:06.268780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:06.269745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:06.270214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:06.270705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:06.271617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:06.272150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:06.273735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:06.283697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 162/332] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:06.289337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:06.419227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ead-2d84-41b2-bb8a-f3e104800f7a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:06.460203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:06.460854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:06.461128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:06.462032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] PATH_INFO: `/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:06.463331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] RBAC: Authorizing `identity:get_user(user_id=7ab36ea9f68644b0806934f8a0a5ccc7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:06.464836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e9d5-0c2f-45f4-bef5-2f804d5b6387 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:06.466812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 171/333] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:06 2022] GET /identity/v3/users/7ab36ea9f68644b0806934f8a0a5ccc7 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:06.472716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:06.613765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf617e-3d6a-42e5-bbe1-83b64a872031 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:06.651536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:06.652198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:06.652475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:06.652739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:06.653528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] RBAC: Adding query filter params (role.id=2c8acee661db441aae043379c7020618, user.id=7ab36ea9f68644b0806934f8a0a5ccc7, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:06.653829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:06.655244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf96e-5df3-4fdb-91d7-9c75dc7fb926 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:06.671812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 163/334] 10.222.0.95 () {56 vars in 1308 bytes} [Fri Aug 5 19:51:06 2022] GET /identity/v3/role_assignments?user.id=7ab36ea9f68644b0806934f8a0a5ccc7&scope.system=all&role.id=2c8acee661db441aae043379c7020618 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:08.124370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d51c-f57f-4a21-a11a-8d285a8d3cc5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.124888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d51c-f57f-4a21-a11a-8d285a8d3cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.124888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d51c-f57f-4a21-a11a-8d285a8d3cc5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.126531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 172/335] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:08.131581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b33bf-e710-4999-ae37-009da28e4a54 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.132010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b33bf-e710-4999-ae37-009da28e4a54 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.132175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b33bf-e710-4999-ae37-009da28e4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.154006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-db0b33bf-e710-4999-ae37-009da28e4a54 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:08.155206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-db0b33bf-e710-4999-ae37-009da28e4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:08.170186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:08.246943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 164/336] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:08.285530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843d51c-f57f-4a21-a11a-8d285a8d3cc5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:08.361177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:08.392171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b496-539d-4566-847b-48eab59afcf2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.392339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b496-539d-4566-847b-48eab59afcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.392616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b496-539d-4566-847b-48eab59afcf2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.393968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 165/337] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:08.409742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843d51c-f57f-4a21-a11a-8d285a8d3cc5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:08.413718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.414250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.414996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.449834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:08.451021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:08.475334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:08.476022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.476297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.476709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.501198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:08.506356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:08.507206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:08.508609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 173/338] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:08.514691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:08.557029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 166/339] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:08.595325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:08.698492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:08.715709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbc9b-794d-4f17-b59d-c65a7afb13d4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:08.734850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f3bf5-9476-4a24-88a5-4a226a7f2882 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:08.775306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:08.787334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:08.788115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.788389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.788654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.790853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:08.791589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:08.791891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:08.792161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:08.792892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:08.793245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:08.794626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:08.803489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 174/340] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:08.804955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:08.809965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:08.812035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:08.814008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 167/341] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:08.815594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:08.822623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:08.953957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc072-3b82-42a1-b0b4-eb00ef5df19f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:08.961585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459002-ef21-4572-9951-ad42bd3f2e97 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.001070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.001702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.001975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.002244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.002965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:09.003264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.004668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c4a2d-fcb0-4896-933a-da98d4b5a31d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.007866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.024787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 168/342] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:09.025943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539446-378e-4a09-844e-b65d5f98e2a2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.026222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539446-378e-4a09-844e-b65d5f98e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.026506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539446-378e-4a09-844e-b65d5f98e2a2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.030658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.031284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.031559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.031929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.033883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 169/343] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:09.034628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539446-378e-4a09-844e-b65d5f98e2a2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.114657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.141593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.143366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f005cf-c2af-4c0a-b0e1-da3a1ec7c58f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.164665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539446-378e-4a09-844e-b65d5f98e2a2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.203162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.204141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.204665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.205069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.275150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.284245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.286277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8434f5-93d2-447b-a33e-154e8e160b6a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.372426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 175/344] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:09.373724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.374069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.374342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.396773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 170/345] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:09.398332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9298-3479-4b9b-94b9-13410d0ef9f1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.398839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9298-3479-4b9b-94b9-13410d0ef9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.399374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9298-3479-4b9b-94b9-13410d0ef9f1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.400682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 171/346] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:09.401366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9298-3479-4b9b-94b9-13410d0ef9f1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.408249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:09.409747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:09.499471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 176/347] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:09.500571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.514953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.523113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9298-3479-4b9b-94b9-13410d0ef9f1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.527290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.564889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.565708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.566069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.566428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.568878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.571113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c955c1-9303-4c7e-98dd-6e8aa19bd5ae None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.573414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 172/348] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:09.574667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.575046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.575416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.599070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:09.600683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:09.628571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741a934-b0f7-4f8f-9d87-cd2bfbe6492b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.675810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.676710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.677128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.677408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.678984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.680432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.682276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 177/349] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:09.683109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 173/350] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:09.683988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.684946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.803167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.814327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:09.823086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0ec80-c727-4e9c-93f3-99fb0c732bbe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.823254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8703e-f4d3-4698-a853-d2a9cefd906a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:09.869938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.870624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.870898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.871165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.871477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:09.872380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.872847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.873318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.879571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:09.880329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf80a4-238a-496a-93e7-da49fa386a03 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:09.882014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 174/351] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:09.883697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424715-7e96-44e6-a492-8d2df02655e6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:09.885167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424715-7e96-44e6-a492-8d2df02655e6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:09.885439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424715-7e96-44e6-a492-8d2df02655e6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:09.890758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 175/352] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:09.890758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424715-7e96-44e6-a492-8d2df02655e6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:09.891761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:09.897120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:09.898009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:09.899550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:09.901399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 178/353] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:09.904658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.018952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424715-7e96-44e6-a492-8d2df02655e6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.031521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87b42-5f30-4b8a-b505-20b9da552832 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.063844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.064244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.064516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.064785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.066543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:10.068464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:10.070884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 176/354] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:10.076735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.088299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.091368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.091368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.091648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.108716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-84f3e4e2-4f34-4b58-81c2-1abde28e4218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:10.116217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:10.117788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:10.118904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 179/355] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:10.120451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.120747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.121019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.126458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.138277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.145629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:10.146925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:10.214004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae13083-05e2-4f91-8370-c7c82e7ccc0a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.248748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 180/356] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:10.249561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.259025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.260178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.260178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.260364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.261021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:10.261544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:10.262869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:10.269405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 177/357] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:10.270123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.403492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.403806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98379-e845-4b6a-bdc0-d30266475301 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.417349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf79f-0383-455a-b833-68346d698a67 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.465531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.465939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.466577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.466774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.466888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.467115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.467442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.467890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.468013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=2c8acee661db441aae043379c7020618, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:10.468266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:10.469024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:10.469477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:10.469689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:10.471130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:10.473759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.476596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 178/358] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=2c8acee661db441aae043379c7020618 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:10.481157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.481653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 181/359] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:10.482540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.623069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790ddb-e74e-4664-b25f-30caa4b7cea5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.630259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339589-a929-4e4a-8214-eb325ca678ac None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.681316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.682076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.682421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.683241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.685190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.686440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.686919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.687460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.688738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:10.689227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:10.691098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:10.696526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8433e6c3-c9f6-4feb-98a1-87869e299c85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:10.705654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:10.706622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:10.708072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 182/360] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:10.713917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c62ad-73ff-4d78-9a94-2618d9764987 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.713917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c62ad-73ff-4d78-9a94-2618d9764987 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.713917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c62ad-73ff-4d78-9a94-2618d9764987 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.714381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 179/361] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:10.714694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 183/362] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:10.715754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.720375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.720576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.720969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.741471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.749194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:10.750823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:10.818145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:10.833648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 184/363] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 19:51:10.835628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:10.851093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558efbb-c1c5-4112-903b-f535e0511971 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:10.908094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:10.908996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:10.909120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:10.909422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:10.960278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75607b-7faf-48e9-a9c7-fceba52e0b1c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.004106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.006174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.007023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.008615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.009359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.009919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] PATH_INFO: `/v3/users/bf820ba19e7c494ebc59c0daea5410d2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.011593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] RBAC: Authorizing `identity:get_user(user_id=bf820ba19e7c494ebc59c0daea5410d2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.013311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.019933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 185/364] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/users/bf820ba19e7c494ebc59c0daea5410d2 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:11.021244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.026187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.108189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.143467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 180/365] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:11.144807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.150895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6b95-8c8e-4bd6-b553-fc1808cca263 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.190447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.191074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.191350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.191617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.192376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:11.192676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.194024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.203993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 186/366] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:11.204927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.265445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6a16-25d4-4f56-994a-be65caa7a7bd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.289501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.312638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.313696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.314198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.314671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.323532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f840-4b65-4c56-9066-e54beed512f5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.327138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:11.332729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:11.333630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:11.334403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:11.337769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 181/367] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:11.338989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.348205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.368237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.368858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.369137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.369407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.370304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] RBAC: Adding query filter params (role.id=f291718185ed4de49bf39a3eb44da9a5, user.id=bf820ba19e7c494ebc59c0daea5410d2, scope.system=all) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:11.370617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.372066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.391809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 187/368] 10.222.0.95 () {56 vars in 1308 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/role_assignments?user.id=bf820ba19e7c494ebc59c0daea5410d2&scope.system=all&role.id=f291718185ed4de49bf39a3eb44da9a5 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:11.391809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.546442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9dc7-fe6f-4289-a287-b5790f796cf7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.597192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63431-feb3-4b9c-923d-7d110f730be2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.598210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.599266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.600730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.601296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.645937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.646917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.647397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.649495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.650959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.652693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.659190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 182/369] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:11.660605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.678450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.709854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.711511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.717386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.802128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903712b-8110-4e2b-8d65-d5257150f5e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.847691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:11.848500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:11.848889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:11.849169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:11.849902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:11.850216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:11.853371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:11.854883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 188/370] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:11.856202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.863101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 183/371] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:11.863997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:11.955916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:11.985538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf97e0-fcd9-411a-8db2-247f2231b370 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:11.990908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247bfd-4ef3-49d5-bed2-47fbb65144e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.000043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.031832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.032035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.032624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.032905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.033197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.033808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.034278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.034483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.035209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.036223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.036914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.038206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 184/372] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.039230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.039354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.041631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 189/373] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:11 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.047840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.153927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2506c-2b4d-4bee-b80b-4407d4d00898 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.168272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fba7c-ea38-43f7-b3d7-4a58c68b8c05 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.191105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.191736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.192058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.192328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.211002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.212105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.212791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.213273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.215147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.216892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.219763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 190/374] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.221132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.241637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.252877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.280887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.282356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.346929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce0ad-b83c-472e-8d7c-292bd36f6ca6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.387966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.388980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.389548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.390009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.391050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=2c8acee661db441aae043379c7020618, scope.project.id=e18533b0d92a42b6885a2394664db9be) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:12.391548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.393219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.394037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 185/375] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:12.394956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.400536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 191/376] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=2c8acee661db441aae043379c7020618 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.406240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.502206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.534259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07829-fd16-403f-bb55-89e1d071b619 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.582404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.583043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.583323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.583596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.584439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=e18533b0d92a42b6885a2394664db9be) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:12.584749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.587732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec98f-75c6-430f-ab62-35d640bfdad0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.596030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 186/377] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.597973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ee73-8950-41be-8415-0df9710422a1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.598386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ee73-8950-41be-8415-0df9710422a1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.598664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ee73-8950-41be-8415-0df9710422a1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.600828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 187/378] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:12.601417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.606495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.606832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.607037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.636411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b257-67b0-4737-9742-adb6672a11f4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.653074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:12.654432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:12.684759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.685648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.685933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.686208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] PATH_INFO: `/v3/projects/77f7a859119a4ba5a9748b0c556b058a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.687502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] RBAC: Authorizing `identity:get_project(project_id=77f7a859119a4ba5a9748b0c556b058a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.689497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.691343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 192/379] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/projects/77f7a859119a4ba5a9748b0c556b058a => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:12.700013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.792865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 188/380] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:12.836576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20ad27-f21b-45da-9fd6-529d26247fff None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:12.837326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.881555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:12.882211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:12.883166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:12.883533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] PATH_INFO: `/v3/groups/020eef177f564c47be75e5a534d025c0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:12.899963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] RBAC: Authorizing `identity:get_group(group_id=020eef177f564c47be75e5a534d025c0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:12.901538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:12.903655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 193/381] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/groups/020eef177f564c47be75e5a534d025c0 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:12.921004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:12.933889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:12.956323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:13.014705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902003e-db8b-434a-850f-cbac1df96e37 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.038171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df86b37-1268-423b-9851-8b2f693db43e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.067246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.067948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.068229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.068500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.081607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:13.087890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:13.088997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:13.089939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 189/382] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:13.091449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.093607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.093607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.093607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.093607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] RBAC: Adding query filter params (group.id=020eef177f564c47be75e5a534d025c0, role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=77f7a859119a4ba5a9748b0c556b058a) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:13.093916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:13.096901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.097054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d240-652d-49c1-88d8-1f57db81d359 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:13.105833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 194/383] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:12 2022] GET /identity/v3/role_assignments?group.id=020eef177f564c47be75e5a534d025c0&scope.project.id=77f7a859119a4ba5a9748b0c556b058a&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:13.190380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4f70-9d50-4bc1-a86f-b444fc90dabe None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.190988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4f70-9d50-4bc1-a86f-b444fc90dabe None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.190988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4f70-9d50-4bc1-a86f-b444fc90dabe None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.192294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 195/384] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:13.201314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.201621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.201860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.245010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:13.246140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:13.280770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61298ea-a423-487a-8f67-0a5d7f676509 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.344165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:13.352632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.353278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.353552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.353825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.356391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:13.356702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:13.358147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:13.377916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 190/385] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:13.386116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.409196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 196/386] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:13.434212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.448386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:13.548368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ca27-9218-4abd-b6be-2e1a75e49a59 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.613895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb702e2-ccf1-4c01-9f76-8420c120d830 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.628770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.629929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.631604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.632139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.634729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:13.636668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:13.640456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 191/387] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:13 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:13.649933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.690998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.691659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.691961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.692228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.715421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:13.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:13.723744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:13.724559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 197/388] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:13.732797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.770596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:13.842793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484719c9-5f78-4e56-8880-de91b347f037 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.858210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:13.911669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:13.912340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:13.912614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:13.912881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:13.915840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:13.917269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:13.920017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 192/389] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:13 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:13.922895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7ebe-dec5-406a-a9b6-779a5f5ca625 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:13.925203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:13.999675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:14.000328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:14.000596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:14.000858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:14.001575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:14.001870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:14.003222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:14.022627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 198/390] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:14.027144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:14.120570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c798c-2c5b-468a-aa6e-396a4c66eb7a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:14.151702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:14.158803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:14.159729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:14.160167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:14.160443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:14.162783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, group_id=ce6117c00fd34c879a43b9e983cf9a4b, role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:14.164809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:14.179931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 193/391] 10.222.0.95 () {58 vars in 1442 bytes} [Fri Aug 5 19:51:13 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:14.223553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62071-b404-4b79-85f5-180fbaf2b2b6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:14.253895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:14.266158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:14.266864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:14.267140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:14.267405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:14.268705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:14.270143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:14.272091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 199/392] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:14 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:14.279146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:14.409247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921892-c068-41d0-aa55-6f8e51f8f184 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:14.446055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:14.446777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:14.447103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:14.447373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:14.448578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:14.450034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd76a20-c5af-4032-a9ec-e60ad1a9cb41 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:14.452190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 194/393] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:14 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:14.461634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:14.579658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab959-cdfb-4309-a9c6-32631c476efe None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:14.617569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:14.618337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:14.618614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:14.618886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:14.620859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075, group_id=ce6117c00fd34c879a43b9e983cf9a4b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:14.622448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb79fb-11b6-470c-adcf-438911b35449 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:14.640814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 200/394] 10.222.0.95 () {58 vars in 1442 bytes} [Fri Aug 5 19:51:14 2022] PUT /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:15.177372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4005cf2-c39d-4959-a85b-62c133f96e3b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.177898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4005cf2-c39d-4959-a85b-62c133f96e3b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.178297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4005cf2-c39d-4959-a85b-62c133f96e3b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.180923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 195/395] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:15.186381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fede-1d93-4b9b-b8d6-f0589b3c4f9d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.186865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fede-1d93-4b9b-b8d6-f0589b3c4f9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.187279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fede-1d93-4b9b-b8d6-f0589b3c4f9d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.188878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 196/396] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:15.190526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.190970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.191379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.193940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.194373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.195471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.229360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:15.230506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:15.232224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:15.233502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:15.324142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:15.326851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:15.363910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 201/397] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:15.365471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 197/398] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:15.384113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.406604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.551516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d77bb-511f-4471-800f-83a7de5e9089 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:15.588154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:15.588853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.589135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.589402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.600024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:15.605143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:15.606010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:15.607196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 202/399] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:15.612276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.619901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70548f-658d-4d1c-b70f-65954be8f7f3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:15.676146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:15.706953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:15.707617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.707966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.708246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.738770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf82ec-164d-4fbe-ab9d-97180cb2ecd2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:15.740381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c9d27e14-304b-49da-892c-9a5bcd696e53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:15.746824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:15.747749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:15.748857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 198/400] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:15.749810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9830f-edc8-45cb-9c0c-5ed0df796ec3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.749810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9830f-edc8-45cb-9c0c-5ed0df796ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.750093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9830f-edc8-45cb-9c0c-5ed0df796ec3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.754859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 199/401] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:15.755909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9830f-edc8-45cb-9c0c-5ed0df796ec3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.787719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:15.788466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.788743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.789016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.789766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:15.790040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:15.791409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c510-435a-4889-92d8-3ed21b05aea2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:15.800350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 203/402] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:15.806083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.806083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.806083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.815977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:15.824058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:15.825255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:15.874109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9830f-edc8-45cb-9c0c-5ed0df796ec3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:15.895274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 204/403] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:15.904227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.912609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:15.913568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:15.914051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:15.914518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:15.915460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:15.915984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:15.917830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:15.926546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 200/404] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:15.927572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:15.980148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.042242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4522-b16b-4b67-89c5-ccc34ee3b8fc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.046571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7d97f-02ef-48a8-81da-49315907b770 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.051829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.081921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.082909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.083383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.083903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.092622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.093331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.093683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.093950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.095622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.097190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.103817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 205/405] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.103817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.114379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:16.120025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:16.121679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 201/406] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:16.123235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.241939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80eac7-1e7c-4807-ac2d-a19cbad78f54 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.257776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1df9d-1dfe-4862-a18e-c2f0f960e38a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.272249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.281920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.282871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.283359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.283864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.285486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.287516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.295394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 202/407] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.296720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.302590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.303462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.304292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.304685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.306250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.307768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.310466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 206/408] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.311603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.343103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.427390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aed5f-80f3-4e49-aa87-7f8b9f438412 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.457329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efd03e-01c6-42d6-8315-cd8a2e7676f6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.463734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.464442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.464718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.464988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.465752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:16.466056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.467412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.476255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 203/409] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.477173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.503210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.504076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.504365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.504689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.507642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, group_id=ce6117c00fd34c879a43b9e983cf9a4b, role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.509430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.527402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 207/410] 10.222.0.95 () {58 vars in 1442 bytes} [Fri Aug 5 19:51:16 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:16.533710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.586814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.606160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.614837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4c5-8478-44e4-8b3a-100c3531478e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.656638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.658049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.658534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.658948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.660715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.662485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.665994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 204/411] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.672274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.771715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7fb3-c380-4f74-a169-4750c611607b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.813135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.813777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.814275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.814389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] PATH_INFO: `/v3/groups/020eef177f564c47be75e5a534d025c0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.815453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] RBAC: Authorizing `identity:get_group(group_id=020eef177f564c47be75e5a534d025c0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.817048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.818863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 208/412] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/groups/020eef177f564c47be75e5a534d025c0 => generated 229 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:16.826073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:16.837289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cca82e-76d7-48d5-a18b-8403652e6af7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.875540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:16.876572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.877082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.877650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.879911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e18533b0d92a42b6885a2394664db9be, group_id=ce6117c00fd34c879a43b9e983cf9a4b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:16.881630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a272432-7a14-4cde-9c67-a4fe583b11a9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:16.910474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 205/413] 10.222.0.95 () {58 vars in 1442 bytes} [Fri Aug 5 19:51:16 2022] PUT /identity/v3/projects/e18533b0d92a42b6885a2394664db9be/groups/ce6117c00fd34c879a43b9e983cf9a4b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:16.930283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45f6d-586b-458c-80d6-17b35fe8ba04 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.930612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45f6d-586b-458c-80d6-17b35fe8ba04 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.930839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45f6d-586b-458c-80d6-17b35fe8ba04 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.932550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 206/414] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:16.941314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:16.941594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:16.941859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:16.955319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa1fe8-1096-4798-a42f-636baeb51206 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:16.984232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:16.997504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:16.998732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:17.016617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.017284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.017617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.017898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] PATH_INFO: `/v3/projects/77f7a859119a4ba5a9748b0c556b058a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.020167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] RBAC: Authorizing `identity:get_project(project_id=77f7a859119a4ba5a9748b0c556b058a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:17.021666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:17.026005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 209/415] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:16 2022] GET /identity/v3/projects/77f7a859119a4ba5a9748b0c556b058a => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:17.036163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.041984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.129257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 207/416] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:17.158806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.196726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2f69d-3709-4154-867a-63442171dbba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.236093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.237131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.237634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.238103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] PATH_INFO: `/v3/projects/77f7a859119a4ba5a9748b0c556b058a/groups/020eef177f564c47be75e5a534d025c0/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.240469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] RBAC: Authorizing `identity:create_grant(project_id=77f7a859119a4ba5a9748b0c556b058a, group_id=020eef177f564c47be75e5a534d025c0, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:17.243137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629a61e-3afb-4ee0-9990-1537283e0f5c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:17.257772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 210/417] 10.222.0.95 () {58 vars in 1442 bytes} [Fri Aug 5 19:51:17 2022] PUT /identity/v3/projects/77f7a859119a4ba5a9748b0c556b058a/groups/020eef177f564c47be75e5a534d025c0/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:51:17.259631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8214-6e37-47c7-af16-c04afade3396 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.260948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8214-6e37-47c7-af16-c04afade3396 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.261647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8214-6e37-47c7-af16-c04afade3396 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.263771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 211/418] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:17.269106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.269743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.270355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.277731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd44e8d-2209-4f2b-9195-41259ee8b325 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.291435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:17.293022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:17.322209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.334973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.336081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.336598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.337004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.349600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:17.355629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:17.356808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:17.357741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:17.360190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 208/419] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:17.366056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.381104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 212/420] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:17.390384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.427795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.484711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4ea1-9c93-4724-8319-f9e13dd401d0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.525558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.527069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.527733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.528188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.529213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:17.529657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:17.531269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:17.541359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 209/421] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:17.547140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.599972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf3c8-6275-4eb5-96e6-422f8084b93d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.636832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.642540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.643276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.643667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.643987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.655515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:17.661387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:17.662251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:17.663584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 213/422] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:17.665658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39fa8d-f57a-4658-a6ec-0e2bf14bbca8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.672953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.710577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.719341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.720361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.720838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.721300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.836681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:17.838868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:17.912962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425e55-2f16-4df3-96ac-25d542cc1b30 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:17.932157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:17.966331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 210/423] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:17.974766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:17.980617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:17.981526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:17.981999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:17.982486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:17.983396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:17.983916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:17.986414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:17.996732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 214/424] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:18.009094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:18.130313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9196-21a0-443e-b390-b2be2579d1e0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.133346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:18.177966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa881-d173-4c92-b6f6-45ac390b633d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.211282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.212083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.212358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.212626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.213854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.215278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.217378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 211/425] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:17 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:18.222748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:18.237061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.237697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.237972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.238236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.278916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:18.348800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b604-f50a-4c4f-90fd-879cbd9d1148 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.392951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.393614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.393888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.394156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.395662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.397462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.400046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 212/426] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:18.412576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:18.415484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.417512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.499685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:18.535731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 215/427] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:18.540472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:18.641646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9371c-f44f-47fb-ad69-7e0b743392be None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.652228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397fe4a-91f1-40c1-9c88-e802e5d624cb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.672642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:18.689618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.690652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.691152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.691617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] PATH_INFO: `/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.693304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a13b1cc6b640f0b77f2ad8c87a1075)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.695547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.697509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 216/428] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/projects/d0a13b1cc6b640f0b77f2ad8c87a1075 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:18.706423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.707049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.707394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.707671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.708369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:18.708475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:18.708785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.710411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.723805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 213/429] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 611 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:18.817381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:18.890785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322ae1-437d-44d9-b9e9-66f1761ac186 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:18.937591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:18.938232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:18.938505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:18.938771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:18.939990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:18.941373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccb1f0-3d9b-44a8-8098-3463b5bf476a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:18.943274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 217/430] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:18.952921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.059951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510ef0-f2a3-4fe5-a649-972865f5898e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.060275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510ef0-f2a3-4fe5-a649-972865f5898e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.061008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510ef0-f2a3-4fe5-a649-972865f5898e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.062784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 218/431] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:19.069629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.069913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.070563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.082269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b714-7062-471f-a095-21f7b6c0f345 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.095402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:19.096782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:19.143154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.143845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.144074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.144346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.145595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=2c8acee661db441aae043379c7020618, scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:19.145904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:19.147941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:19.157860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 214/432] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:18 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=d0a13b1cc6b640f0b77f2ad8c87a1075&role.id=2c8acee661db441aae043379c7020618 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:19.197823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 219/433] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:19.222258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.275435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.347413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db464280-77d9-48c8-8054-345e62e5e67a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.384771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12146895-293e-4718-bb77-995f78328d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.385422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12146895-293e-4718-bb77-995f78328d8d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.385696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12146895-293e-4718-bb77-995f78328d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.385969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12146895-293e-4718-bb77-995f78328d8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.397973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12146895-293e-4718-bb77-995f78328d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-12146895-293e-4718-bb77-995f78328d8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:19.403438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:19.404391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:19.405178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 215/434] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:19.411047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.454540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261665d-f190-432e-ac0b-0d387be9c03f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.454833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261665d-f190-432e-ac0b-0d387be9c03f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.455195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261665d-f190-432e-ac0b-0d387be9c03f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.456854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 216/435] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:19.462671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.462954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.463231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.471913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.487690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:19.488934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:19.548738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d438ce-fdb3-4621-9023-17cfdddc471b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.578273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 217/436] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:19.592564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.593583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.593860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.594130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.594886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:19.595192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:19.596601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:19.602894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.608969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 220/437] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:19.614312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.642497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.733659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc8db-eff9-474d-959f-3c7bf42eb2de None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.752317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba9d6-46b6-4244-83cf-fe6bb69c3282 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.765458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.783131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.784211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.784477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.784747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.800339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:19.805751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.806601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:19.806727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:19.807549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 19:51:19.808553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:19.809408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 218/438] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:19.809747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.810022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.821009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:19.896137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:19.897729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bd961-1f27-4365-8be2-a0a6bf643a2e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:19.929307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:19.939450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b8b-fe3b-4e55-aef1-9c7273ca11ea None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:19.973465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:19.974072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.974350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.974618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.975897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:19.976204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:19.977564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1ddc-e7df-4251-911d-3ca65569956e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:19.985509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 219/439] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:19.986592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470e09-50a4-4265-96fa-798b13c7ed33 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:19.986869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470e09-50a4-4265-96fa-798b13c7ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:19.987138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470e09-50a4-4265-96fa-798b13c7ed33 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:19.988527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 220/440] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:19.991688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470e09-50a4-4265-96fa-798b13c7ed33 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.000488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 221/441] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:20.001744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.002029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.002304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.014962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.021112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:20.022493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:20.089485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 222/442] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:20.090333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.106857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470e09-50a4-4265-96fa-798b13c7ed33 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.146506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.147161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.147444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.147733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.171466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.211546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2564a-60f7-473f-a9b1-9c8069c058fe None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.220814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.222264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.246031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.246690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.246945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.247208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.248370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.249788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.251543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 223/443] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.252320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.255511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.326343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 221/444] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:20.331394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.355356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee8dd-8598-422f-a0f3-64ea7ff55933 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.383085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.389257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.389897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.390177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.390443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.401282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:20.408059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:20.409312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:20.410074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:20.410695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 224/445] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:20.411537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.439750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c5bbd-ff3a-4f45-83a3-c17b50b0ecf0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.473568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.474446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.474712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.474977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.476261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.477669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.479263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 222/446] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.479376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.480018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.521630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d61ba-db3f-4b0f-b001-cc140fed5225 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.555960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.556592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.556858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.557122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] PATH_INFO: `/v3/projects/e18533b0d92a42b6885a2394664db9be` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.558264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] RBAC: Authorizing `identity:get_project(project_id=e18533b0d92a42b6885a2394664db9be)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.559682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.561349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 225/447] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/projects/e18533b0d92a42b6885a2394664db9be => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.562098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.580824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270c437-a145-4391-b22c-b1dd082b20ba None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.602117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.617092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.617725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.618001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.618434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.619145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:20.619444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.620836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.629068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 223/448] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.629848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.666069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e609d-3e18-40a4-b89b-86b57cf0d4dd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.695047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.700454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.701156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.701432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.701708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.702492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=e18533b0d92a42b6885a2394664db9be) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:20.702797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.704246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.710432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 226/449] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.711341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.740788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa1fc-2d8d-497a-aa1c-6af8d0263120 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.778244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.778809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.779083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.779364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] PATH_INFO: `/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.780616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] RBAC: Authorizing `identity:get_group(group_id=ce6117c00fd34c879a43b9e983cf9a4b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.782076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.783730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 224/450] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/groups/ce6117c00fd34c879a43b9e983cf9a4b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:20.792730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:20.838388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a004-f499-40f0-b546-dce182c010b9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.847733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.882004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.882919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.883248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.883520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.906591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6206-ddb9-4a16-847e-f417dc7db548 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:20.945667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:20.946273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:20.946547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:20.946810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:20.947590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] RBAC: Adding query filter params (group.id=ce6117c00fd34c879a43b9e983cf9a4b, role.id=2c8acee661db441aae043379c7020618, scope.project.id=e18533b0d92a42b6885a2394664db9be) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:20.947918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.949557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:20.953187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:20.955676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 225/451] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/role_assignments?group.id=ce6117c00fd34c879a43b9e983cf9a4b&scope.project.id=e18533b0d92a42b6885a2394664db9be&role.id=2c8acee661db441aae043379c7020618 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:20.960723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:20.962265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:21.068160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 227/452] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:21.073939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:21.181136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8429d-e7dc-4b65-9117-1a80e6a585d5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:21.194962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:21.216947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:21.217592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:21.217865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:21.218129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] PATH_INFO: `/v3/projects/77f7a859119a4ba5a9748b0c556b058a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:21.219285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] RBAC: Authorizing `identity:get_project(project_id=77f7a859119a4ba5a9748b0c556b058a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:21.220731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:21.222676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 226/453] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:51:21 2022] GET /identity/v3/projects/77f7a859119a4ba5a9748b0c556b058a => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:21.228766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:21.325015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:21.332062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d82e2-da6b-41a6-a92f-02832d70cbf2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:21.370400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:21.371064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:21.371338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:21.371608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] PATH_INFO: `/v3/groups/020eef177f564c47be75e5a534d025c0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:21.372795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] RBAC: Authorizing `identity:get_group(group_id=020eef177f564c47be75e5a534d025c0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:21.374251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385149b0-db29-4f4a-9556-de8d0a5db82b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:21.375872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 228/454] 10.222.0.95 () {56 vars in 1180 bytes} [Fri Aug 5 19:51:21 2022] GET /identity/v3/groups/020eef177f564c47be75e5a534d025c0 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:21.382398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:21.490539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390c36-a9d2-49fc-93ae-0446582e5765 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:21.524044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:21.524624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:21.524900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:21.525170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:21.525961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] RBAC: Adding query filter params (group.id=020eef177f564c47be75e5a534d025c0, role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=77f7a859119a4ba5a9748b0c556b058a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:21.526263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:21.527677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5090-e0b7-4d84-bc5b-e7a6e2e03abf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:21.533544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 227/455] 10.222.0.95 () {56 vars in 1376 bytes} [Fri Aug 5 19:51:21 2022] GET /identity/v3/role_assignments?group.id=020eef177f564c47be75e5a534d025c0&scope.project.id=77f7a859119a4ba5a9748b0c556b058a&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:24.166985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9241-bf0f-4199-8300-680efda57db7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.167498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9241-bf0f-4199-8300-680efda57db7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.167600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9241-bf0f-4199-8300-680efda57db7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.169439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 229/456] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:24.174207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db26e7-139a-47e7-9034-63b2bc8448c9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.175026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db26e7-139a-47e7-9034-63b2bc8448c9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.175706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db26e7-139a-47e7-9034-63b2bc8448c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.183816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c42b-54b5-4b4f-8fcf-2c2a4651b6cc None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.183816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c42b-54b5-4b4f-8fcf-2c2a4651b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.183816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c42b-54b5-4b4f-8fcf-2c2a4651b6cc None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.185264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 230/457] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:24.192292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.192866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.193332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.205601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c9db26e7-139a-47e7-9034-63b2bc8448c9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:24.206633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c9db26e7-139a-47e7-9034-63b2bc8448c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:24.230194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:24.231388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:24.286867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:24.324052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 228/458] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:24.325438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb82dc-6a51-40e5-bbad-d7836640abe1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.325720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb82dc-6a51-40e5-bbad-d7836640abe1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.325993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb82dc-6a51-40e5-bbad-d7836640abe1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.327551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 229/459] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:24.338887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 231/460] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:24.341616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.341900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.342176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.356840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.371399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:24.372969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:24.450884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 230/461] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:24.452067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.477763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:24.486744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129cfb-e8c7-4c38-8d2f-33e29cac3a7c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.533813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.535055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.535471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.536026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.552147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.554157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:24.566376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf4697-db16-41ba-a06f-b6b1f555f72b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:24.574876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:24.575875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:24.576735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:24.576735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:24.576735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.576735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:24.576735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 232/462] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:24.577729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.581474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:24.606526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.607454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.607937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.608419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.620365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.622051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:24.639667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:24.640574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:24.641391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:24.641391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:24.641391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.641391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:24.643236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 231/463] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:24.644226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.703341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d28b-bbfa-4cbd-8da7-4a184ac2f122 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.739428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.741508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.741995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.742462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.753874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.755679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:24.763296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:24.767850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beee4-ff5a-4a56-a5e5-387ab2aff55d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:24.773909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:24.774741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:24.775562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:24.775562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:24.775562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:24.775562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:24.782623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 233/464] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:24.784042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.808183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.809474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.809759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.810031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.810733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:24.811032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.812961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:24.830854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 232/465] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:24.832161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.855878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:24.892395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6375bd-5846-4aa4-8628-fefee8a3340c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.927620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.928311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.928670 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.928930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.929630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:24.929916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.931279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30122-63d2-4909-af1f-624bf280d4dd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:24.943587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 234/466] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:24.945024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057458-7cc7-481f-ab3c-15a089a1284e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.945382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057458-7cc7-481f-ab3c-15a089a1284e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.945725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057458-7cc7-481f-ab3c-15a089a1284e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.947156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 235/467] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:24.950941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057458-7cc7-481f-ab3c-15a089a1284e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:24.953558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a0aa-0a56-4212-96b5-c7b423798779 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:24.989806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:24.990438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:24.990710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:24.990977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:24.991655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:24.991982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:24.993478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.010792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 233/468] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:25.010792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.018211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.075309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057458-7cc7-481f-ab3c-15a089a1284e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.093525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.114349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.114959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.115982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.116094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.116880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.118295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18883074-fc03-4060-a86c-80375c84cab8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.119326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62f8-55f4-4f34-89ec-07e4e4699036 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.141906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 236/469] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:24 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:25.143580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.144105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.144668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.167376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:25.169721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:25.172034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.172717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.173267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.173550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.174300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.176619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.214085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 234/470] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:25.221040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.314357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 237/471] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:25.343459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.394754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9333b-370d-4cde-865a-e14b6d87508d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.413511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.442776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.443485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.443772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.444074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.445177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.448062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7aed-9811-44d8-8951-9db9b072cce7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.460297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.487214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 235/472] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:25.488381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ac87-02f7-45a2-9f58-e05bfc3a56f9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.488664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ac87-02f7-45a2-9f58-e05bfc3a56f9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.488939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ac87-02f7-45a2-9f58-e05bfc3a56f9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.490371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 236/473] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:25.496158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.496487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.496711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.501307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba28e2-c66c-4aec-a9f4-2e2225b86402 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.522413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:25.523655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:25.566317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.567519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.568613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.569413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.584811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.587266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:25.608862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:25.609828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:25.610659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:25.610659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:25.610659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:25.610659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:25.613492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 238/474] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:25.620752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.622351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 237/475] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:25.645334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.752435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.759347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1c639-1cfd-4356-bbb3-00cf790e56a2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.761293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fdab7-aecc-4df4-9690-249368fd7c01 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:25.787015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:25.808209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.809066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.809437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.809784 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.810571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.811356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:25.812183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.812419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:25.812864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:25.813312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:25.814179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:25.814667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:25.816512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:25.822029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.sql.core [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 19:51:25.822029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 19:51:25.822029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [parameters: {'id': '7947d40127984064ae8b9d0c319a8556', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 19:51:25.822029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 19:51:25.834877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 239/476] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 05 19:51:25.839904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:51:25.840754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application yield resource Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise self.value Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application session.commit() Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 19:51:25.841648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.flush() Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application compat.raise_( Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 19:51:25.842511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:51:25.843375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:51:25.844682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [parameters: {'id': '7947d40127984064ae8b9d0c319a8556', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:25.845456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 19:51:25.846225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:25.847191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 238/477] 10.222.0.95 () {60 vars in 1131 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:25.848392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.848520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:25.997107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb1fa-582a-4f23-bb09-888b9eb177ed None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:26.045312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:26.046055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:26.046331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:26.046599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:26.072197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a43d4b-f5c8-4fcd-88ab-1bbe6870d8fa None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:26.074418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:26.083408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:26.084695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:26.085595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 239/478] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:51:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:26.091131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:26.112620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:26.113287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:26.113567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:26.113834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:26.114560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:26.116362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726d95-c160-417c-b6c0-0104074e0024 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:26.140056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 240/479] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:25 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:51:26.188729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:26.270547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed9c8-df93-4c1b-b7e0-eac803c656b5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:26.322717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:26.323272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:26.323547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:26.323836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:26.324644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:26.324949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:26.326356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27729-5c2b-44bf-9fd4-aefb5ed0b1ff None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:26.340360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 240/480] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:27.814995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcdb7d-aadc-4695-bfbe-27aeba2ebf9b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:27.815740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcdb7d-aadc-4695-bfbe-27aeba2ebf9b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:27.815740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcdb7d-aadc-4695-bfbe-27aeba2ebf9b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:27.817170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 241/481] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:27.828290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:27.828815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:27.828815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:27.859078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:27.860296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:27.887388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cc7f1-ca0e-43c0-9793-304c35f8b138 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:27.887719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cc7f1-ca0e-43c0-9793-304c35f8b138 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:27.887970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cc7f1-ca0e-43c0-9793-304c35f8b138 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:27.889681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 242/482] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:27.894733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:27.895009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:27.895277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:27.913973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:27.915292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:27.923560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:27.972520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 241/483] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:28.021771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 243/484] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:28.043955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.048606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.107307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.206539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116dae-4a48-41c0-9f06-c38b990ca600 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.207318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7148e2-31ed-424a-8aa0-bd1332dbe739 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.257824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.258483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.258749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.259013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.264199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.264880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.265160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.265426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.284819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:28.290625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8f80f33a-9e95-4713-9a45-98b97f3dd2d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:28.291837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:28.292715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:28.293506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 242/485] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:28.294613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782911-275d-4c58-873c-e7959ab9858f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.295908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782911-275d-4c58-873c-e7959ab9858f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.295908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782911-275d-4c58-873c-e7959ab9858f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:28.296085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:28.296884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.298748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:28.300257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 243/486] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:28.300394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 244/487] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:28.306071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.306303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.306559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.306894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.309390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.327742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:28.329084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:28.412599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 244/488] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:28.412599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.418921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461d00-a263-46a8-aa37-ec3e17ffb299 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.451422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.474765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.475540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.475859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.476135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.476912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:28.477217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:28.478597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:28.488130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 245/489] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:28.488979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.546892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d47b1-7bb6-4897-a3ee-4a91c1a19ddb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.566282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.588220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.589203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.589656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.590095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.591120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:28.591565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:28.593107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:28.603690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 245/490] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:28.604957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.606964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d7484-e40b-447a-b5cd-26e139a219fd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.641961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.642661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.642937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.643204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.654410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:28.660921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:28.662098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:28.663343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:28.667310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 246/491] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:28.668143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.712291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.727694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538d85-5c55-4c8b-885c-b19bab09dec1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.766368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.767433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.767879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.768288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.773345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6971-6002-4f91-bcd7-1765e990e642 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.780770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:28.782524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:28.797743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:28.799308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:28.800836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:28.801728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:28.801728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:28.801728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:28.801728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:28.801728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 246/492] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:28.802021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.814013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.814656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.814932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.815203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.827387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:28.828885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0a5035b1-b3e2-4ce1-91ab-253ca8f451b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:28.852014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:28.852935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:28.853790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:28.853790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:28.853790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:28.853790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:28.854834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 247/493] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:28.855704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831939e5-9be6-49d6-a30b-1766caf0e987 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.856003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831939e5-9be6-49d6-a30b-1766caf0e987 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.856280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831939e5-9be6-49d6-a30b-1766caf0e987 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.857725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 248/494] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:28.861149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831939e5-9be6-49d6-a30b-1766caf0e987 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.926925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6a2-7b47-4aae-8357-5e6ba850ad88 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:28.960995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:28.961603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:28.961881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:28.962146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:28.962852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:28.963151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:28.964531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:28.972361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 247/495] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:28.973225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:28.975961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:28.977117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831939e5-9be6-49d6-a30b-1766caf0e987 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.011487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.012131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.012406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.012670 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.013346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.013639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.014993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a03399-1680-43c4-b0b2-c102e92950f2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.026591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 249/496] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.027771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1508-518d-4a07-820e-eb2235251e18 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.028066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1508-518d-4a07-820e-eb2235251e18 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.028342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1508-518d-4a07-820e-eb2235251e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.046288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b1ad1508-518d-4a07-820e-eb2235251e18 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:29.047461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b1ad1508-518d-4a07-820e-eb2235251e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:29.074940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852f19-5192-4f38-83cc-76f782487068 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.075523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.111104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.111714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.112017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.112285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.112969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.113268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.114457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 250/497] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:29.114600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.116705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c67f-82a7-4746-af00-0511a0205a7d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.116989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c67f-82a7-4746-af00-0511a0205a7d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.117267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c67f-82a7-4746-af00-0511a0205a7d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.118508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 251/498] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:29.119287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c67f-82a7-4746-af00-0511a0205a7d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.127721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 248/499] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.128727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.205186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.238026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c67f-82a7-4746-af00-0511a0205a7d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.253862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69102c-4dad-4bc7-93a1-61685b636903 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.272054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.272687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.272963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.273229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.283635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.285114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.290312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.290943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.291286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.291559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.298950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.300427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-01da4114-7fae-47a0-9e1f-9acc6c45e020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:29.301022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:29.302017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:29.302888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:29.302888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:29.302888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:29.302888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:29.302888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 252/500] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:29.303656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.303902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.304171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:29.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:29.319394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 249/501] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:29.320373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.324916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:29.326087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:29.340143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.393520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 253/502] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:29.394362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.434615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec64cbc-ac63-4b88-bb72-1ee6c13e0e46 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.457920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.470593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.471232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.471512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.471800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.480196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.481645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:29.492904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:29.493816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:29.494678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 250/503] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:29.495214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.506852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928256f-7195-41cf-9247-a42104e60b38 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.541878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.542505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.542779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.543078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.552789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.554457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.562787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:29.571328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:29.572367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 254/504] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:29.578642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.595628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308757c-e48f-45db-9857-b3d1479d8fd5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.629151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.629905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.630182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.630989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.631673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.631999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.633339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.644875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 251/505] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.645656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.674586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e3e1-bbf9-409c-b4e9-f1126fc7d73d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.688117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.708108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.708937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.709278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.709551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.710409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.710707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.712135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.747080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8e10-116f-472d-85a9-a6a59ba8baed None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.749861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 255/506] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.750678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.781107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.781841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.782118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.782382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.793992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:29.798852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:29.799969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 252/507] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:29.800940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.811707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.858462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46342024-11f9-40cf-9e65-593e87dbedb8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.893406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.894023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.894295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.894629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.895427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.895732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.897441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.904174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba263-0923-432b-852f-918bb40b0dfe None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:29.905689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:29.916414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 256/508] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.916894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:29.944670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:29.945285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:29.945560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:29.945831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:29.946530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:29.946828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:29.948261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:29.960130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 253/509] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:29.960884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.019689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c9f8-2ef8-42d7-8be3-8fea14f57cdb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.037919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.055605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.056273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.056549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.056817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.062504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c3292-9d53-45a9-8fce-e3e70ca9c0dc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.063904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.065335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:30.078710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:30.079773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:30.080722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 257/510] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:30.081274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.098667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.100068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.100567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.100847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.130020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.169158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.170600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.182297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8844-3601-471a-956a-86aea960ecc2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.216954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.217508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.217781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.218046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.218756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:30.219051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.220440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.230233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 258/511] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:30.231142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.273621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 254/512] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:30.274261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.278753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.337287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.337950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08ea63-16fc-40cd-a1dc-0e56c0aeddab None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.372589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.373230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.373506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.373771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.376390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180d13-3a41-4233-a809-ad8cf426070a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.410204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.410815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.411091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.411362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.412581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.414003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.435179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 255/513] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:30 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:30.436028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.448620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.450099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.496468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.577966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0569d-3f4b-4413-bd1d-1d000cdee8b5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.579878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 259/514] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:30.580750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.605626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.628327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.629057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.629333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.629596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.630419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:30.630719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.632237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.673880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 256/515] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:30.675187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.699883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de784c-a23e-4c15-a977-3b0a71fd5bd1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.737727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.738496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.738748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.739129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.746150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.752186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.754653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:30.772236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:30.773359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 260/516] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:30.774167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.789997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748b8e-6bd3-41df-a3a9-e26dc6ab0d57 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.825733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.826379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.826652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.826932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.838549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.840150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:30.856797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:30.857859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:30.858912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:30.858912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:30.858912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.858912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:30.860386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 257/517] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:30.861297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.888160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16e770-4795-4edf-9ad1-59b8e0568fe6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:30.892109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:30.932594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:30.933156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:30.933435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:30.933708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:30.946167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:30.947630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:30.963599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:30.964540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:30.965368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:30.965368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:30.965368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:30.965368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:30.965368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 261/518] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:30.966134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:30.981378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746e05e-5c6e-4fce-bb24-0e385e29c91b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.013858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.022625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.023244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.023518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.023796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.078746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104b787-02a5-488c-b94d-30e88d1b1973 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.103103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.104736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.115334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.115988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.116263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.116541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.117231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:31.117533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.118880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.132052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 262/519] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:31.133143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.139520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.225774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 258/520] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:31.225774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.247116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96eda-5b74-4f0c-adf8-eca405191b8d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.248840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.289397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.289938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.290216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.290491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.291184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:31.291485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.292859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.309001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 263/521] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:31.309001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.342447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b760-a6f7-4084-ae16-cc2257064d43 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.371575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.380444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.381146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.381425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.381698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.382398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:31.382698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.384089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.400102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 259/522] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:31.400102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.423266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dc952-3774-4797-8640-49dc1080bfbd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.460914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.461542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.461813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.462080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.469793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.471217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:31.483147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:31.484110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:31.484964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 264/523] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:31.489540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.513369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95b43-2904-4825-a721-2a9421dc8705 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.514557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.552810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.553775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.554273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.554566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.565891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.568282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:31.585899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:31.586804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:31.587761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:31.587761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:31.587761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:31.587761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:31.587761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 260/524] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:31.588076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.601112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1bf8a-c45e-4b00-b4f8-45e570e97c1a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.638672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.642498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.643138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.643524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.643815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.651279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.652752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:31.666600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:31.667642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 265/525] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:31.668512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.708535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e8a60-960b-4b7a-a95b-dc36b470bafb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.744861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.745489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.745762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.746029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.753238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.754678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.757711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:31.769794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:31.770698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:31.771523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 261/526] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:31.772523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.781468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba142-7c76-4019-8652-70678e3ffbed None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.816903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.817435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.817761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.818030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.818818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:31.819120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.820566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.838168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 266/527] 10.222.0.95 () {56 vars in 1139 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:31.838967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.889373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:31.893615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a74d2a-4a9f-4298-9a91-22f1c02da73f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:31.935523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:31.936182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:31.936462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:31.936746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:31.937421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:31.937931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:31.939092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:31.954142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 262/528] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:31.956552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:31.959504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a124-bee0-4134-b67b-5187292c7c0e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.002929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.003927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.004407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.004896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.006880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.007403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.009663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.029765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.041229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 267/529] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.042619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.070536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b70-31a7-40a7-ae1f-51ca410fd63c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.109563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.110290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.110569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.110961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.111691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.112022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.113422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.136532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 263/530] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.137854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.153199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7b7d2-15d9-4eb5-9fbc-41f690ee3225 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.163044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.190536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.191155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.191435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.191714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.255973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c025-876a-4bf9-9d61-1dd3c19bbe9e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.268577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.272273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.274376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.297897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.298533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.298808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.299083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.306810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.307992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:32.320813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:32.321636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:32.322455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 264/531] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:32.323720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.388038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 268/532] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:32.393476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.415097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.437814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9590b9-5f72-40ec-9239-d62fdcfdba4f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.472230 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.472844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.473130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.473402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.474377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=a3e8c4b63db4457aab286cf3f228dd26) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.474695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.476139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.491818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 265/533] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/role_assignments?user.id=a3e8c4b63db4457aab286cf3f228dd26&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.491818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.510791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.514481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0955e-3cc9-4638-afbf-53cab289c3f6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.558943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.559570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.559875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.560146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.560947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.561251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.562701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.568883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 269/534] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.569738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.609612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128413-4692-48cb-870b-e22f11a44757 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.664356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.665330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.665810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.666269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.667240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.668670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.671181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f584-b9e1-47e1-9d70-6cfa62387b0f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.684422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 266/535] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.685693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc4e-1564-4a66-8350-b182df23690f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.685972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc4e-1564-4a66-8350-b182df23690f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.686241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc4e-1564-4a66-8350-b182df23690f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.691554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 267/536] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:32.693385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fc4e-1564-4a66-8350-b182df23690f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.708440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d854-5ddc-4b84-8b89-a89c4ca5dad5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.720173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.761047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.762269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.762721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.763407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.780845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.783722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9d3afc63-1348-417e-aaba-f710c03fba33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:32.805179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:32.806245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:32.807411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:32.807411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:32.807411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:32.807411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:32.810326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 270/537] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:32.814920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.814920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.814920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.827373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fc4e-1564-4a66-8350-b182df23690f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:32.835991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:32.837283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:32.849534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:32.882292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:32.883828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:32.884305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:32.884906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:32.886329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:32.887242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:32.889253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:32.897636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 268/538] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/role_assignments?user.id=2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:32.899104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.931124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 271/539] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:32.967305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:32.998066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.090489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9ada-4e95-4554-b37c-fb031b90673c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.100610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e1b25-9960-4097-b44f-0d2d7d2e54b4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.133498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.134042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.134317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.134579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.135278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:33.135577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.136978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.148733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.149716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.150191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.150347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 269/540] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:33.150778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.155678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.164178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:33.169840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:33.170677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:33.171433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:33.174096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 272/541] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:33.181215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.191658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.261554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678a6cd-8998-4699-8506-a1c9927d9f4e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.304555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.307078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff0ca-c65a-4557-8932-65b3c173f59e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.329189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.329847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.330126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.330398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.348046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.349640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.350149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.350621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.351592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:33.352186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.353757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.360730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.362199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.367912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 273/542] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:33.370513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:33.388212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:33.389080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:33.389900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 270/543] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:33.395148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.447963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.487582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116124-28d0-4adb-aafb-c90b9331569c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.526547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.527644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.528154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.528634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.541088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.542893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:33.558444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:33.559317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:33.560179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:33.560179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:33.560179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:33.560179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:33.562386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 274/544] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:33.568734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.579763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d6ce7-3008-45bf-a720-5a3d0551e242 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.672541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.673174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.673448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.673808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.674471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:33.674773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.676362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.681955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80b52-5b7c-4af9-84d1-b9d01768f136 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.689494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 271/545] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:33.695638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.705072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.722215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.723185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.723735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.724374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.725374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:33.725875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.727628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.741572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 275/546] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:33.747221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.793718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:33.861384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff09c-70ab-4eee-b4e3-363bad76aa18 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.901153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.902158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.902813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.904061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:33.907718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fce28-8898-4f81-81f3-c98e453ce77c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:33.917046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:33.918511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:33.940902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:33.941782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:33.943460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:33.953323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 276/547] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:33.955469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:33.993573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:33.995539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:33.999004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:33.999575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.000597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=732dac2174a84e28be298417ecc2370a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:34.001120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:34.004459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:34.015486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 272/548] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/role_assignments?user.id=732dac2174a84e28be298417ecc2370a&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:34.031997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:34.105589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682783a-3534-4879-a9c0-63e5ca40a12c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:34.147518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:34.148573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:34.149049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:34.149530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.150535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:34.151061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:34.152767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:34.174628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 277/549] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:51:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:34.180742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:34.323376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dd95-4942-49a7-acee-db89b1d6da4c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:34.337316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:34.360225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:34.360897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:34.361178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:34.361449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.432943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:34.434430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:34.535857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 273/550] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:34.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:34.696619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:34.700426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610e6f-9162-421c-b4b7-92f6a625c910 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:34.749379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:34.750029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:34.750304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:34.750570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.764021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:34.765658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-07e51e4b-27de-49ba-9b50-90a8fc6add4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:34.787606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:34.788608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:34.789540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:34.789540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:34.789540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:34.789540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:34.789540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 278/551] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:34.795819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:34.826328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:34.935353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43963-6063-4b67-a6bb-dab0ea4b4b11 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:34.941580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f6d-6860-4006-941e-e73275524304 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:34.941859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f6d-6860-4006-941e-e73275524304 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:34.942132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f6d-6860-4006-941e-e73275524304 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.944349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 279/552] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:34.951874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:34.951874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:34.951874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:34.977737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:34.978922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:34.999896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.000516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.000790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.001054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.001745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:35.002048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.003388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.026110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 274/553] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:35.031431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.113075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 280/554] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:35.154282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.160724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.205234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f662-d23a-45b0-a18c-9d8f3ce41563 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.262437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.263182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.263454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.263719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.271544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.273019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.278456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4ebbeb17-1325-4444-a8ff-12e362cd76eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:35.287801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:35.288688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:35.289549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 275/555] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:35.290444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5981-2e9d-4dc6-bdca-c875d0490e6f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.290444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5981-2e9d-4dc6-bdca-c875d0490e6f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.290634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5981-2e9d-4dc6-bdca-c875d0490e6f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.292101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 276/556] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:35.294861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5981-2e9d-4dc6-bdca-c875d0490e6f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.311040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89dc7-7217-4717-be65-7a103bbb1c75 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.363132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.363804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.364176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.364601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.378845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5aac2711-deea-4c23-91ad-a5ee210d35c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:35.385880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:35.386909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:35.388181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:35.394118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 281/557] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:35.396127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223796f3-6af2-4f3b-bacb-1bfed211cd96 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.396618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223796f3-6af2-4f3b-bacb-1bfed211cd96 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.397439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223796f3-6af2-4f3b-bacb-1bfed211cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.420704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-223796f3-6af2-4f3b-bacb-1bfed211cd96 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:35.421899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-223796f3-6af2-4f3b-bacb-1bfed211cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:35.435580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5981-2e9d-4dc6-bdca-c875d0490e6f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.468985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.475341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.476019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.476300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.476585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.477341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:35.477650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.479076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.492632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 277/558] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:35.493535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.513141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 282/559] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:35.515010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04094-911d-4300-a728-3c7251ccbc1f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.515761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04094-911d-4300-a728-3c7251ccbc1f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.516361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04094-911d-4300-a728-3c7251ccbc1f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.518126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 283/560] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:35.519505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e04094-911d-4300-a728-3c7251ccbc1f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.606253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.613912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa7ae-863a-4d72-bae3-f939809c1f6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.649647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e04094-911d-4300-a728-3c7251ccbc1f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.656404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.657703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.657978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.658240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.659360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:35.659676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.661841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458f70f-29ff-4930-8282-26bdcb4208bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.674627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 278/561] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:35.674627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505790-8e65-46d2-bbe1-00530356deca None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.674627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505790-8e65-46d2-bbe1-00530356deca None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.674627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505790-8e65-46d2-bbe1-00530356deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.690131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.690750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.691018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.691292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.691549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-73505790-8e65-46d2-bbe1-00530356deca None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:35.693053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=05de568d5ff94ae6a72ce2d795e408de) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:35.693496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-73505790-8e65-46d2-bbe1-00530356deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:35.693610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.695026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.700828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 284/562] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/role_assignments?user.id=05de568d5ff94ae6a72ce2d795e408de&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:35.712915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.755256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.779551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 279/563] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:35.780576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505790-8e65-46d2-bbe1-00530356deca None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.878706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c0c0-8080-4175-bd61-55dd59cc70d2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505790-8e65-46d2-bbe1-00530356deca None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:35.923256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.924212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.924500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.924767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.928599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:35.941613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:35.948813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:35.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:35.951036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:35.951961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:35.951961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:35.951961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:35.951961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:35.952216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 285/564] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:35.952216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:35.968641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:35.970146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:35.993305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:35.994788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:35.997073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:35.997073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:35.997073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:35.997073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:35.998019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 280/565] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:35.998316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.047430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.095398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940849ef-daf6-4148-950b-2dadab90e9f4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.127252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3088-429c-4385-b511-16aca0cb1a89 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.138392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.139763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.140262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.140748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.152528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:36.158961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:36.159898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:36.160700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:36.163758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 286/566] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:36.164839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.172440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.174420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.175723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.176224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.177789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:36.178379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.179969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.189147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 281/567] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:36.190231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.245183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.303769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.306055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20817e2f-35b4-4042-81de-af248d6c9e75 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.307918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dfc1d-c172-426c-81ec-2053b8410305 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.344457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.345170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.345449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.345721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.346550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:36.346852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.348362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.350414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.351206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.351556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.351930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.352694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:36.353065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.354587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.357440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 282/568] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:36.358014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.367876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 287/569] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:36.368854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.475805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111646f-9801-47de-96e7-a8221bf20b2f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.485444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701c3c-3efa-42aa-839c-2a8ccb486314 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.501518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.511399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.512067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.512350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.512621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.523352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.523613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.524014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.524285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.524550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.525242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.536510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.538140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:36.540943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:36.541821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:36.542699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:36.542699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:36.542699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:36.542699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:36.546742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 283/570] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:36.547443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f76737b2-f322-466e-a722-2d7d6f295e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:36.556167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:36.557024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:36.557898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:36.557898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:36.557898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:36.557898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:36.560085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 288/571] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:36.562088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9616-02a0-470e-89ef-09ac62fc4d9b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.562783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9616-02a0-470e-89ef-09ac62fc4d9b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.563060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9616-02a0-470e-89ef-09ac62fc4d9b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.564672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 289/572] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:36.565215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b9616-02a0-470e-89ef-09ac62fc4d9b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.569711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.662856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f77d-75a2-4ab8-b383-e9db9842ac63 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.668742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b9616-02a0-470e-89ef-09ac62fc4d9b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.698905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.699654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.700012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.700279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.702346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.703006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.703229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.703499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.704218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:36.704517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.705868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.709449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.711227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.718359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 290/573] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:36.719167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5166ee1f-dd14-436b-8782-bf4af3635fa4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:36.725558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:36.726488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:36.727411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:36.729259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 284/574] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:36.730534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.730953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.731228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.750065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:36.751258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:36.756714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.827252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 285/575] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:36.833763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.836270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce956e-a8cf-4f81-872e-acf38fdf98a8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.836738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.879019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.879863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.880266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.880539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:36.881236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:36.881536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:36.882914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:36.894419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 291/576] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:36.895820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:36.955505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff02eb-046d-448c-bc03-91605b02ca15 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:36.989141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:36.994150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:36.994822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:36.995093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:36.995358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.002601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.004036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.005545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a9f5-a60b-4fb0-9e63-318a77e9ca94 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:37.018501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.019503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:37.021113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:37.025475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 286/577] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.026189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.045358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.045980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.046255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.046757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.047323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:37.047631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.049108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.072148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 292/578] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:37.072148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.096663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.140861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f215a-613a-4ed5-8089-bad006b09e87 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.176005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4a76-cd8b-4a98-a3c7-8be78459c68e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.179127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.179788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.180078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.180349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.190849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:37.196798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.197764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:37.198594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 287/579] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.199272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.217149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.217805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.218060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.218334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.226827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.228322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:37.241365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.242317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:37.243226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 293/580] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.243944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.248130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.316974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44451af6-927e-45ca-bad6-a1300a43d87c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.344813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.358177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.358722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.358995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.359260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.360084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:37.360378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.361788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.368851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d190-3e6a-46b0-aa30-6f9235188b41 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.383974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 288/581] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:37.384915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.416243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.419283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.419283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.419283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.433228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.434845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:37.451071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.452057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.452998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:37.452998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:37.452998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.452998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:37.452998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 294/582] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.453304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.499227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e6fe-7f78-46f3-abdd-02458ca77e2c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.513500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.535934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.536350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.536713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.536985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.537704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:37.538007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.539386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.548130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 289/583] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:37.554030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.563008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3e805-9740-4c85-9ff3-fb51f1df328a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.600743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.601362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.601665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.601962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.602752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:37.603052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.604006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.604979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.623268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 295/584] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:37.624005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.675857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427c250-1255-4d43-813b-60aeda90c020 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.713052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.713696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.713972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.714458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.726059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.727582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.736967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e558a9-1cd8-408e-b2a3-5dfa0e94627d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:37.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.744714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.745703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:37.745703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:37.745703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.745703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:37.747228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 290/585] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.748175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.755763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.779627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.780270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.780540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.780806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.781497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:37.781791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.783393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.796020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 296/586] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:37.796674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.858882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:37.866985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6fbf4-9d16-4935-8685-477bc788a709 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.902234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.902797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.903074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.903343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.908394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3d41-aaa1-4b59-8cd2-97cbd6f57071 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:37.914804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.916281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:37.930900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.932045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 291/587] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.933415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:37.947306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:37.947974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:37.948251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:37.948522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:37.959027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:37.960513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:37.975348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:37.976283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:37.977160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:37.977160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:37.977160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:37.977160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:37.977160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 297/588] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:37.977428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.004210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.038268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c6c-a8c8-4571-be34-84b65b9a1cfa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.072024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.072404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.072762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.072969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.073606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:38.073901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.075241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c99f7-d6ee-43c7-a98d-b2830af747e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.077669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859451-9d63-4cab-9999-3154fd4b20fd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.087132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 292/589] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:38.089008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e8c-67fc-4453-be7e-6801cd81d791 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.089008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e8c-67fc-4453-be7e-6801cd81d791 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.089008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e8c-67fc-4453-be7e-6801cd81d791 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.091963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 293/590] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:38.091963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118e8c-67fc-4453-be7e-6801cd81d791 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.099827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.117958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.118632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.118905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.119171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.125768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.127187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:38.138957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:38.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 298/591] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:38.140883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.201270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118e8c-67fc-4453-be7e-6801cd81d791 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.227756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.236429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.237039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.237310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.237571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.238252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:38.238544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.240521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.243949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ccb8-adee-47ec-9289-d12a18eb428f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.251513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 294/592] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:38.252322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.281171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.281779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.282313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.282576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.283252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:38.283546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.284917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2681d-930a-4d0d-95f8-cd26ae8e29e1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.297277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 299/593] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:38.298490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.298771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.299039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.317614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:38.318801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:38.320417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.356645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b0b5-8dc0-436d-a82a-5384b155d62e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.385339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 300/594] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:38.386187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.390130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.391410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.391991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.392405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.400999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.402608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:38.415028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:38.416118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 295/595] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:38.417394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.468834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.492021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceba6b-e17d-4d1e-983a-065e93019f98 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.519343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3228a9-0772-43d3-8d01-aab30764b33a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.528889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.529506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.529780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.530055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.530793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:38.531092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.532802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.544866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 301/596] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:38.545653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.549246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.558435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.559151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.559501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.559874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.567449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.568896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:38.580235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:38.581229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 296/597] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:38.582984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.649804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c131b0-1a06-40bb-8248-a950f4b59b83 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.683637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.684312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.684423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5db1-a829-4144-8114-9985d528efcc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.684661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.684939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.687628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.692849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.694592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:38.706329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:38.707984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:38.708991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 302/598] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:38.709467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.724512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.725083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.725359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.725623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.736005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:38.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:38.742326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:38.743148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 297/599] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:38.743884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.790532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.813448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a79cc-ac70-471b-ace6-9bc3c1e1b566 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.848681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362d6c-3d6b-4024-811a-4e57410669bb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:38.852881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.853499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.853852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.854129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.854878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:38.855182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.856639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.869384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 303/600] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:38.870193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.882450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:38.883127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:38.883404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:38.883677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/a3e8c4b63db4457aab286cf3f228dd26/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:38.898247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=a3e8c4b63db4457aab286cf3f228dd26, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:38.899684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:38.913413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 298/601] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:38 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/a3e8c4b63db4457aab286cf3f228dd26/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:38.923369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:38.943765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:38.996400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33301-5540-4bde-bdb1-6ad603c2a12d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.025920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.035102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755cc2-91cf-4ce0-929d-06bf1d760646 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.035667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.037228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.037552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.037828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.038656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:39.038965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.040574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.065710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 304/602] 10.222.0.95 () {56 vars in 1139 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:39.065710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.082175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.083598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.084046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.084326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.085076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:39.085376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.086799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.100132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 299/603] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:39.100942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.181662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be36f4-2015-45d8-9f7e-5f6517cf459e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.197882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.204679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01682da8-c27d-4cf5-b8bc-b3fd87f13423 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.221811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.222601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.223020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.223510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.224319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:39.224680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.226275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.235889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 305/604] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:39.236850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.243377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.244081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.244360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.244633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.260172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=b7f6f07c961a46329912067a520beae1, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.261598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.283821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 300/605] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:39 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:39.283821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.297063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.372416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0f2c-c6a2-48cb-a329-215e50dc22d4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.431893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.432625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.432897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.433500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.449410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.451809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.462880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3df6-0663-4f36-b1e6-5ef3ab90556b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:39.475113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:39.476594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:39.477667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:39.477667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:39.477667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:39.477667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:39.478948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 306/606] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:39.479875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.513936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.518402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.519427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.519923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.520368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.540676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.542655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.561991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 301/607] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:39 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:39.562992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.625837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57d064-d501-41a3-b199-49dae27898d4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.646335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.695024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.695878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.696442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.696812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.721721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.723555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.746690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949a29-027e-4967-a334-ef1ecbf378d2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:39.755115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:39.756090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:39.757033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:39.757033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:39.757033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:39.757033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:39.757033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 307/608] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:39.766627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.830878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.831740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.831967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.832281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.832991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:39.833327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.834705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.848698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 302/609] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:39.853936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.877847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:39.907575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90292-ef30-4d4b-a440-15af13787384 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:39.951634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:39.952625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:39.952968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:39.954175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:39.954968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:39.955359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:39.956821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:39.973865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 308/610] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:39.984802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:39.994342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c6bb-1cf8-4513-b5e9-ca82241265d4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.014604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:40.037682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.038591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.039229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.039881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.048752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.050592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:40.065351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:40.066524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:40.067974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:40.070549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 303/611] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:40.076641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:40.203218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055fdf-7a62-4cea-bbf2-524bf9f2e7ea None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.247801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab190a4-af71-42d3-b546-623dce426632 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.251111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.252056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.252482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.252898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.253894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:40.255060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.257127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.278235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.279025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.279406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.279794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.280869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 304/612] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:40.288104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:40.288941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.290479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.293966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:40.304713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:40.306045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:40.307207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:40.308926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 309/613] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:40.314228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:40.338509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:40.412349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396f6b2-f858-45a6-973f-9d2df3b24d2a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.458783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.459864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.460982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.461406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/732dac2174a84e28be298417ecc2370a/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.491406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=732dac2174a84e28be298417ecc2370a, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.494354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.517146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 305/614] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:40 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/732dac2174a84e28be298417ecc2370a/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:40.574537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0da62-a913-4650-be50-5561702ebc7f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.630069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.631152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.631583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.632026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.633040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:40.633493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.635563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.668358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 310/615] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:51:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:40.673927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:40.801585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:40.821080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f147f4-f5e1-40ae-8586-9b087263b3f8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:40.885788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:40.886368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:40.886647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:40.886915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:40.907147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:40.908641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:40.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:40.933893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:40.934821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:40.934821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:40.934821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:40.934821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:40.934821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 306/616] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:40.939897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.048924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:41.117578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064421-20bf-4f59-a4a7-1c63ee5bf9bc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:41.195351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:41.196108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.196397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.196702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.201175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:41.201495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:41.202907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2416b-76c4-4998-b28d-a9ce4f402aef None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:41.233960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 311/617] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:41.242299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.289890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d2f0-d58e-4587-be39-93ee38007a49 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.290875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d2f0-d58e-4587-be39-93ee38007a49 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.291381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d2f0-d58e-4587-be39-93ee38007a49 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.293247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 312/618] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:41.298801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.299372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.300355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.320641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:41.322217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:41.390269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ce9f-43cf-462e-a9eb-5700e663fa5f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:41.414707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 313/619] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:41.445839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:41.446601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.446880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.447151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.451412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.467992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:41.467992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:41.470550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:41.484896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:41.486920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:41.489983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:41.495250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 307/620] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:41.500608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.562643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:41.664762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37ee9-20d0-41ac-94f8-ace0e0a0673d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:41.694395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91fbfc-7186-45a5-91a6-d834980a4b6e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:41.703819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:41.704355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.704630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.704891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.705625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:41.706416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:41.707961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:41.721949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 308/621] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:41.728853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.796497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:41.797149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.797425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.797694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.799373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:41.821219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:41.831607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:41.832774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:41.833614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:41.835633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 314/622] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:41.847494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:41.880858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30755-52c9-4bfb-a76c-42cda5a1fe2b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:41.949248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:41.949937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:41.950211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:41.950485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/05de568d5ff94ae6a72ce2d795e408de/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:41.972731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=05de568d5ff94ae6a72ce2d795e408de, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:41.974279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf987a6-d162-4cb9-9385-2b6535af2612 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.000080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 309/623] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:41 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/05de568d5ff94ae6a72ce2d795e408de/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:42.002337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c397bc-1c82-49c3-aa27-5a77dd0be93f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.006352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c397bc-1c82-49c3-aa27-5a77dd0be93f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.006352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c397bc-1c82-49c3-aa27-5a77dd0be93f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.006352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 310/624] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:42.023556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.023927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.024304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.057730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d848ec-8aa8-4011-bb31-86539a2d6d27 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.062207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:42.063454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:42.085904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.121438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.122077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.122355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.122626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.123356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:42.123658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:42.125063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.136674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 315/625] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:42.143029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.245269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 311/626] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 19:51:42.265231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc8d09-c615-40e5-89d8-8856f3f7c9d7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.268896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.309766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.310441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.310700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.310970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.314069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.328264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:42.329719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:42.354267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:42.356451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:42.358606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:42.358606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:42.358606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:42.358606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:42.363260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 316/627] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:42.363260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.414078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99948be-a81d-436d-ae73-eec8ea1c1864 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.428295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.473203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.473936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.474206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.474467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.494690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:42.499644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:42.501825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:42.503649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 312/628] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:42.509879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.586810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04ad45-d9d2-4fc0-8720-0e61b0632a34 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.628142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.629386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.629869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.630610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.631646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:42.632151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:42.633810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb5cc0-5ca9-4866-a931-f0acdc37c606 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.647654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 317/629] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:42.649117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18e5d-6708-4273-abab-3aee6340d8e8 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.649398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18e5d-6708-4273-abab-3aee6340d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.649719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18e5d-6708-4273-abab-3aee6340d8e8 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.650963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 318/630] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:42.655812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18e5d-6708-4273-abab-3aee6340d8e8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.666963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.671289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b069-7112-4935-b5d6-959267c6c33c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.717396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.717396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.718649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.719500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.720493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:42.721005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:42.722730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257f811-f987-443c-80aa-c5dab0f4665b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.734673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 313/631] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:42.736440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.737046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.737394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.761900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:42.763818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:42.766912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.789505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18e5d-6708-4273-abab-3aee6340d8e8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.830812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:42.831457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:42.832369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:42.832816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:42.842804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:42.844924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:42.858182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 314/632] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:42.858465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:42.859383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 19:51:42.860950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:42.862685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.868171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 319/633] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:42.868171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:42.979921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:42.981014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9de2b2-3ae1-4d7b-87e7-e33b90595e80 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:42.996167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238aff-b48e-495b-b254-96ae58e4bfad None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.023137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.023679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.024111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.024392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.025201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:43.025510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.026942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.043414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.046220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.047966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.047966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.048265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 320/634] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:43.048370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.048445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.062534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.064719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:43.086194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:43.087139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:43.088058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:43.088058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:43.088058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:43.088058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:43.094114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 315/635] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:43.094114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.158634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515772-0992-47e7-a147-10e6b6a8aa94 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.196157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.196800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.197079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.197350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.199846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca177de-9147-41ad-b22a-d470d9b4d34e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.207744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c30433b9-0c3d-4f3e-a5b0-4255200549ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:43.212664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:43.213811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:43.214786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 321/636] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:43.215490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdc9-5b23-411d-bbb0-1cbd5de2d45c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.215567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdc9-5b23-411d-bbb0-1cbd5de2d45c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.215842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdc9-5b23-411d-bbb0-1cbd5de2d45c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.219918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 322/637] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:43.219918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdfdc9-5b23-411d-bbb0-1cbd5de2d45c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.247522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.248490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.249042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.249318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.265213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.283516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.329451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdfdc9-5b23-411d-bbb0-1cbd5de2d45c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.330095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.331486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510cce-bdb8-4600-950c-daff0159cfc3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.366715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.367345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.367621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.367968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.368667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:43.368962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.371665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.384556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 323/638] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:43.385389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.470687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 316/639] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:43.472239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.472665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.473187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.494169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:43.495373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:43.519146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114e80-8cf3-46bf-91e1-5b31056708b7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.541164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.552212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.569247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.569881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.570160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.570672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.571152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:43.571454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.572850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.579596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 317/640] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:43.582562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 324/641] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:43.587905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.588065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.698135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8031-dab6-4eb0-8178-c35f132c3613 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.712979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60fd3-9aba-43a1-aa6b-3b2a75bfe793 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.755445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.756579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.757276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.757622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.765081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.766554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.766838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.766944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.768083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.768341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:43.782011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:43.783035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:43.784033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:43.788149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 318/642] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:43.788906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.790511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:43.792301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:43.812005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:43.813015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:43.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:43.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:43.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:43.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:43.813893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 325/643] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:43.814180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:43.841063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.860417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:43.939458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547e01-4234-48cf-8cdf-0e47d5ccc29c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.958166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd875e-9ffc-4a78-85f0-ceb6c4b19fc4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:43.978609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:43.979245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:43.979519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:43.979810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:43.992226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:43.997302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:43.998225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:43.999099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:44.000382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.000382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.000382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.000663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 326/644] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:44.000663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.001060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.016597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.018267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:44.034067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:44.035820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:44.036866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:44.036866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:44.036866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:44.036866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:44.040865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 319/645] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:44.041753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.120083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.128450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771bce-6126-41de-97b7-5c66f31c8b22 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.139367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.159702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59ad7-048b-4dda-a1e8-a0e4f2f6110a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.166654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.167341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.167625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.167931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.168802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:44.169103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.170527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.189730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 327/646] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:51:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:44.195147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.199235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.200235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.200514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.200785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.201636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:44.201937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.203289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.216192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 320/647] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:44.216944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.302083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732ace-e43d-48ee-8ac4-e59f105060c1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.331879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a5617-69cc-42c8-a5c6-3b74fc4f006c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.337910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.338524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.338796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.339061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.339772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:44.340093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.341439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.354177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 328/648] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:44.354177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.367184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.367830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.368111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.368383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.369076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:44.369376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.370281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.370719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.383670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 321/649] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:44.384831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.392983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.484034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1e341-8058-4284-bcc2-d82e590aef5f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.498115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9387-afc6-40d2-9304-0be49f929071 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.519268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.520092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.520365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.520636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.533266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.533934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.534214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.534485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.541636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.543084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c381afb8-fd8f-4ae5-91ab-59400331083f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:44.555196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:44.556258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:44.557167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 322/650] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:44.557848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8660336-17c7-4f83-8042-40f7ff55a111 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.558125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8660336-17c7-4f83-8042-40f7ff55a111 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.558393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8660336-17c7-4f83-8042-40f7ff55a111 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.559630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 323/651] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:44.560339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8660336-17c7-4f83-8042-40f7ff55a111 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.590801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.592269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.607824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.627235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.670770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8660336-17c7-4f83-8042-40f7ff55a111 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.693434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 329/652] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:44.694274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.709284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.709930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.710196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.710465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.720879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.722857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:44.738596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:44.740024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 324/653] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:44.741108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.821320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7e54-ab69-4904-bef1-b1b81ca7d54f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.836483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.859891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.860643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.860923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.861191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.869643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.871109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.873730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495382d7-51c3-4d06-bbd3-7643ab5232af None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b58d2ffc-acd7-47b7-8aa0-0a1afffff184 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:44.883496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:44.884506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:44.885445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 330/654] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:44.886520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.886639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.886840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.898254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:44.905424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:44.906889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:44.921332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:44.922371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:44.922663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:44.923199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:44.923996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:44.924460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:44.927069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:44.939694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 325/655] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:44.940528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:44.985687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 331/656] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:44.986649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.062222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0064bd-9a12-4838-8150-d234431816eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.093937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668282-f678-4d15-8516-36f51440d0c2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.096753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.096867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.096989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.097313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.097699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.108079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.109557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:45.124719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:45.125797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:45.126716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:45.126716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:45.126716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:45.126716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:45.126716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 326/657] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:45.126982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.134137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.134695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.134967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.135236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.135961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:45.136253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.137612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.149060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 332/658] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:45.149060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.164504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.241783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0374c-3244-49d9-9dd6-0f227b26afb8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.252290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620657e-c214-42ca-ba56-1d6c1cac8648 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.274431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c454-b137-400a-870d-149916a9571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.275041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c454-b137-400a-870d-149916a9571a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.275312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c454-b137-400a-870d-149916a9571a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.275577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c454-b137-400a-870d-149916a9571a None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.276395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c454-b137-400a-870d-149916a9571a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:45.276693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c454-b137-400a-870d-149916a9571a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.278098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c454-b137-400a-870d-149916a9571a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.287156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.287811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.288079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.288346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.289135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=a3e8c4b63db4457aab286cf3f228dd26) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:45.289437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.290844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.297215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 333/659] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/role_assignments?user.id=a3e8c4b63db4457aab286cf3f228dd26&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:45.297983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.303695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 327/660] 10.222.0.95 () {56 vars in 1137 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:45.303695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c454-b137-400a-870d-149916a9571a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.337499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.421251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676137-55da-498c-bdbf-e84fecbe5212 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.426599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.447551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c454-b137-400a-870d-149916a9571a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.467234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.467924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.468197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.468461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.481505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:45.489327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:45.490473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:45.491303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 334/661] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:45.492053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.503627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.504357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.504604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.504874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.505583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:45.505873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.507232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.521051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 328/662] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:45.522344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.595547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.609251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebefbd0-5ee0-4953-bade-dd0a7383d541 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.634778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a287-5b95-47d7-8d6b-6e6e1e587f88 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.643710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.645156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.645478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.645749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.653549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.654975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:45.667620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:45.668629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 19:51:45.669686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:45.673504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 335/663] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:45.674006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.674928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.675619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.675938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.676210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.695818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.761398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.763163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.784015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85902d-22be-4190-b8a7-030053b0bc5c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.822561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.823178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.823455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.823723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.826416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:45.826721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.828140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.841598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 336/664] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:45.841598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.851473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.886576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 329/665] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:45.887521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:45.937376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:45.949192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fcea7-4c0c-4f27-8ed2-1c87e3a1fd51 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:45.984339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:45.985002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:45.985324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:45.985549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:45.992818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:45.994242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:45.995979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a2db-3658-4c38-8a2f-3773690e05c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:46.006212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:46.007143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 337/666] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:46.012737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.039247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.040021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.040296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.040560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.041354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:46.041653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.043067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.061971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 330/667] 10.222.0.95 () {56 vars in 1139 bytes} [Fri Aug 5 19:51:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:46.063045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.094983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.150560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a8c5-ec30-4851-8014-d5ae030952f9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.176764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae406f-c412-4716-b885-08a7201388ce None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.180022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.189198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.189848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.190124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.190395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.201967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.203394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.214662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.215307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.215582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.215874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:46.217934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:46.218763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:46.219678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:46.219678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:46.219678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:46.219678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:46.219678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 338/668] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:46.219984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.232073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.233405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:46.249443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:46.250335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:46.251240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:46.251240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:46.251240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:46.251240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:46.251240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 331/669] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:46.251518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.334223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b73d2-3150-4825-b0d4-b16b0f2d4bcd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.357055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.369885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.370502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.370725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52a5c-51f2-4777-aadb-9e51d6441364 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.370913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.371154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.371892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:46.372309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.373593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.391970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 339/670] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:46.391970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.413327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.414134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.414460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.414965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.446287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.504152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.506094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.518244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6228-2522-4db6-b152-c4804c56a4f6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.555768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.556404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.556904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.557039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.557660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:46.557961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.559395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.576579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 340/671] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:46.576579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.624636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 332/672] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:46.624636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.627657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.687602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.693963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33eec-8252-424b-adfe-a35288b788eb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.729422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.730098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.730473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.730851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.731628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:46.732147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.733523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.735901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc110b-0302-4dfd-9cb9-9371f7492cee None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.750611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 341/673] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:46.750611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.778931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.779538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.779846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.780118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.780896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:46.781678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.782864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.796230 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 333/674] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:46.797843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.882404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7354-052a-4fc5-ac17-d7e6e0c942c7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.885574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.928014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818fd6e-5c52-4c22-bd4c-a6ade4c40f8a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:46.941963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.943261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.944329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.944829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.953027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:46.959939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.961753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:46.971192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:46.971945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:46.972283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:46.972578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:46.975587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:46.976570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:46.977505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 342/675] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:46.978143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:46.988247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:46.990034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:47.007653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:47.008618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:47.009476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:47.009476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:47.009476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:47.009476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:47.009476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 334/676] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:47.010162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.108247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421d169-330f-4dd3-be7c-c65fd6f1cf41 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.139592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b74bd-de7e-4ca2-9568-2c713b889069 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.156619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.157264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.157540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.157810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.167810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.170533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.180720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.181367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.181643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.181915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.182711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:47.183015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.184479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:47.188139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:47.189042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:47.189933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:47.191694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 343/677] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:47.192698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.208099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 335/678] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:47.209053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.227346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.243112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.318667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753c19-2c9f-4072-bba2-517708f1c9a3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.350040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1c7f-7cd2-488c-a722-82ad7a61b30c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.357990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.358951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.359512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.360035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.360934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:47.361557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.364187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.387378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 344/679] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:47.388797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.390565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.391199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.391469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.392074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.394341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:47.394654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.396109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.412004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 336/680] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:47.412898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.496919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.522259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c697-b852-4e4f-99d9-3d2cf2476715 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.533536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.547489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3637-aa73-471f-845a-df85040be7f1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.563068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.563696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.564004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.564274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.584418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.585058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.585330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.585592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.592484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.593901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:47.605600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:47.606621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:47.607538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:47.613233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 337/681] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:47.614559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.643316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.645583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda5972-0b29-4337-ab0c-899d3045850c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.725828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c47f4-a018-4b34-aab1-9ac49c8c8377 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.736487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.759481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 345/682] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:47.761028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b4de-cb7b-4d82-961a-56863b1f7b5c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.761382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b4de-cb7b-4d82-961a-56863b1f7b5c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.761725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b4de-cb7b-4d82-961a-56863b1f7b5c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.766977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 346/683] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:47.766977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b4de-cb7b-4d82-961a-56863b1f7b5c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.769763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.770400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.770668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.770930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.771722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:47.772051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.773476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.780227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 338/684] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/role_assignments?user.id=2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:47.786000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:47.806914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:47.918033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b4de-cb7b-4d82-961a-56863b1f7b5c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.942648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2bb4-4979-4096-94c4-a7459be5ea56 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:47.959067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.959858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.960140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.960411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.961309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:47.961615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:47.963083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192904b-8594-4287-a0c9-bd47d9e622e5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:47.976648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 347/685] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:47.977987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.978307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.978588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:47.989675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:47.990332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:47.990610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:47.990879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.000362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:48.001601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:48.002903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.005555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:48.022650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:48.023675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:48.024593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:48.024593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:48.024593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:48.024593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:48.024593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 339/686] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:48.026291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.055493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.085295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 348/687] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:48.086472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.114189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.162744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5885a8-0e0e-4690-b562-a33c403326d7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.199491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2a08b-d4d8-4c7b-8582-a9e65dde1cc8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.199942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.200571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.200847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.201116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.202011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=732dac2174a84e28be298417ecc2370a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:48.202323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.203867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.210593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 340/688] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/role_assignments?user.id=732dac2174a84e28be298417ecc2370a&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:48.211623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.240797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.241870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.242376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.242805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.243682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:48.244158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.245767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.260512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 349/689] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:48.265877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.352347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.423851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64bb04-dfcc-4676-85ed-5f24fc89d7f1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.447840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47f6f-f238-4ef3-b5db-7c0c703f9ac0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.462355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.472750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.473553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.473833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.474103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.489945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.491398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.493363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.494066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.494340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.494604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.502327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.504270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:48.509974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:48.510859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:48.511740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:48.511740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:48.511740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:48.511740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:48.511740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 341/690] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:48.516943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:48.522496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:48.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:48.526966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:48.528086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 350/691] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:48.531835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.668577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29a4d-2883-46c5-b5dd-bc62a7f2dc4f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.682509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.695511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3870-15b7-40e2-a92e-aa751c6fe6c2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:48.747508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.748733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.749979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:48.750444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.751188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:48.751601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.752481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:48.752910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:48.753518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:48.754420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:48.754881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.756417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.756883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:48.758427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:48.785870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 342/692] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:48.791790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.792767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 351/693] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:48.815140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:48.872386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:48.953711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a65b6-8a99-4e84-84b9-12dd97cc7a9f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:49.002158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:49.003166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.003589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.004046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.004893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:49.009906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054575bb-3fb8-4a90-9be5-7b5c9cdcf904 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:49.056028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 343/694] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:51:48 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:49.059265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d060-82db-4593-b3be-0b9b9047d996 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:49.108306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:49.109688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.110302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.110921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.112265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=05de568d5ff94ae6a72ce2d795e408de) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:49.114104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:49.116200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688207af-bc74-4a9d-a5f2-79f8d1c751b7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:49.128034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 352/695] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:48 2022] GET /identity/v3/role_assignments?user.id=05de568d5ff94ae6a72ce2d795e408de&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:49.153732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e6774-503b-4a7e-8b19-2c891e33b37b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.154007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e6774-503b-4a7e-8b19-2c891e33b37b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.154277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e6774-503b-4a7e-8b19-2c891e33b37b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.160227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 344/696] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:49.162653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.162935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.163212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.189667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:49.191070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:49.210683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:49.308253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 353/697] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:49.332246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e6774-503b-4a7e-8b19-2c891e33b37b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:49.442512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:49.449481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e6774-503b-4a7e-8b19-2c891e33b37b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:49.488373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:49.489296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.489673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.490036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.501094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:49.506845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:49.509312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:49.510326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 345/698] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:49.517362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:49.625849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bc18-f9fc-4ed6-897e-5b8f9d3da6cc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:49.663658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5cea-e543-4957-8117-677313b86189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:49.664584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5cea-e543-4957-8117-677313b86189 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.665012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5cea-e543-4957-8117-677313b86189 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.665429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5cea-e543-4957-8117-677313b86189 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.666378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5cea-e543-4957-8117-677313b86189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:49.666830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5cea-e543-4957-8117-677313b86189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:49.668421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5cea-e543-4957-8117-677313b86189 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:49.677891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 354/699] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:49.683717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:49.827206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5c98a-f41a-46a2-815f-196ad1fb0e76 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:49.884502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:49.885164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:49.885442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:49.885716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:49.900257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:49.901706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:49.919515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:49.920528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:49.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:49.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:49.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:49.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:49.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 346/700] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:49.928133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5cea-e543-4957-8117-677313b86189 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:49.944524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:50.120461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5cea-e543-4957-8117-677313b86189 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:50.204522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:50.205160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.205441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.205713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.207309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:50.207611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:50.209006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ddf2-361b-4ea9-be23-f957bd729e7a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:50.342976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 355/701] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:50.349346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:50.365963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbfe3-4b0f-4197-884d-d1a91f2b2593 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.366153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbfe3-4b0f-4197-884d-d1a91f2b2593 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.372067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbfe3-4b0f-4197-884d-d1a91f2b2593 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.372067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 356/702] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:50.375066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.375345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.375615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.380952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:50.403711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:50.404934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:50.527989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd6fc-1bcd-4594-90ea-aec26fba6318 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:50.566086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:50.566820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.567109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.567378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.575756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:50.577482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:50.590675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:50.591674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:50.592715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 347/703] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:51:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:50.600668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:50.625517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:50.649525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 357/704] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:50.685487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:50.696193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:50.734822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3042-40ce-4979-a603-a401581a7f53 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:50.774770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:50.775758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.776743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.777368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.778567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:50.779287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:50.781621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:50.804678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 348/705] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:51:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:50.811503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:50.914617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5fb5-c581-41f5-b60f-eed024a88c2c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:50.962977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:50.964151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.964663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.965134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.966001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:50.967578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ebd65c1f-fba6-49b6-9ad6-8cc7d1940423 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:50.980270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:50.981333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:50.982176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:50.985173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 358/706] 10.222.0.95 () {56 vars in 1129 bytes} [Fri Aug 5 19:51:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:50.986688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d01be-68ea-4088-9dde-53410310026c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:50.987957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d01be-68ea-4088-9dde-53410310026c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:50.988504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d01be-68ea-4088-9dde-53410310026c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:50.990287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 359/707] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:50.993319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d01be-68ea-4088-9dde-53410310026c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.062485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34d89-a9b3-4d96-af40-9a396236950c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.077238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.089395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.099043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.099677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.100014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.100300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.126749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d01be-68ea-4088-9dde-53410310026c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.167119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.168294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.168916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.169393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.170277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:51.170836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.171076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.172572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.173060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c373590-01cb-4260-838a-4dd278e3bdb4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.179044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 360/708] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:51:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:51.180593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.181140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.181671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.210827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:51.213781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:51.292690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 361/709] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:51.293543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.305624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 349/710] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 19:51:51.306925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.339798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.375809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.422906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337f273-395f-4eea-827b-b7729b47f3be None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.432313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4971c-743a-4bef-85aa-0389f414a734 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.460420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.461003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.461378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.461848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.462544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:51.462954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.464466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.475888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 362/711] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:51.477621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.479585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.482833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.483313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.483740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.508058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.510065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:51.527566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:51.528579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:51.529504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:51.529504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:51.529504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:51.529504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:51.531593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 350/712] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:51.550879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.640312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36d49-2d61-4e80-ab2d-c55a838dfa8d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.660393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.667007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.685537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46507d2-a5e6-4a64-b4cc-c4274d4df779 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.687017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.689081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.689568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.689990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] PATH_INFO: `/v3/services/network` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.691058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.692769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f71b149d-656a-427d-8219-3fbb3442dbda None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:51.706574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:51.707641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:51.708637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:51.709414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 363/713] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:51.711629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0cab-cb38-4160-8c76-af98c535792f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.711952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0cab-cb38-4160-8c76-af98c535792f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.712229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0cab-cb38-4160-8c76-af98c535792f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.714085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 364/714] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:51.716673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0cab-cb38-4160-8c76-af98c535792f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.729592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.730347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.730788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.731151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.731967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:51.732364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.734099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b044-be10-48f9-a187-651f51c20555 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.748041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 351/715] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:51.749425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.749797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.750262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.774079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:51.775625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:51.829039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0cab-cb38-4160-8c76-af98c535792f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:51.859844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 352/716] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:51.859844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.875534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:51.876673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.877191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.877727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.878718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] RBAC: Adding query filter params (name=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:51.879411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:51.881481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651450d-e454-4c8b-9d52-af8752bad55d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:51.886782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 365/717] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:51.887984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f73c6f-f903-4892-88a7-8217814de307 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:51.888454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f73c6f-f903-4892-88a7-8217814de307 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:51.889217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f73c6f-f903-4892-88a7-8217814de307 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:51.890233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 366/718] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:51.890968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f73c6f-f903-4892-88a7-8217814de307 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:51.937873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.952859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:51.973041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ca00-7edd-4a33-abae-3f34a587fbd6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.008873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.009490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.009767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.009885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f73c6f-f903-4892-88a7-8217814de307 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.010049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.017212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.018719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:52.039826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:52.040955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 353/719] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:52.042053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.060494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.061139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.061422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.061677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.073041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-133c8e42-1a99-49f4-97e0-e2a14d802918 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:52.077639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:52.078565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:52.079386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 367/720] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:52.080551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f961d-9132-419a-9191-019af4447289 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.080551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f961d-9132-419a-9191-019af4447289 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.080551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f961d-9132-419a-9191-019af4447289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.103282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e83f961d-9132-419a-9191-019af4447289 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:52.104525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e83f961d-9132-419a-9191-019af4447289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:52.155992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d09b6-755d-4add-878d-56d73dac6938 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.179857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 368/721] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:52.179857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f961d-9132-419a-9191-019af4447289 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.198710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.207083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.207869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.208163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.208525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.209278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:52.209736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.211229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.224164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 354/722] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:52.225068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.230719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.306463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f961d-9132-419a-9191-019af4447289 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.358783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.359858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.360410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.360970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.362780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:52.363318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.365480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.372403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06c2a-66e9-4ccb-b9b6-9425e3174e27 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.381175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 369/723] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:52.382313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.420284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.421077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.421445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.421810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.422628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:52.423815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.425319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.437142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 355/724] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:52.438078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.501822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.508651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.513612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07987-5046-47b4-8b14-04b23f575bae None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.549279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da443-bdee-49bc-92fb-6988f561cdc4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.553923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.554764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.555186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.555600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.568517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:52.574012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:52.575116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:52.576249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:52.578724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 370/725] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:52.579651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.589475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.590237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.590897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.591032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.591951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:52.592354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.593968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.600781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 356/726] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:52.601603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.723812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc73ab-2464-4363-a054-73bac008026b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.746385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195428f5-6a75-4190-bb74-f916bd9aa0e7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.768948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.769486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.771639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.772115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.786820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.787363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.787679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.788089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.788450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.789278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:52.789633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.789738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.791278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:52.801478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 357/727] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:52.806683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:52.807735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:52.808853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:52.808853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:52.808853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:52.808853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:52.809122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.810940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 371/728] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:52.825551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:52.847638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:52.926608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548ad8-dd3b-4f3c-845c-0914a513cdc2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:52.971939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:52.972997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:52.973687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:52.975245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:52.989142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:52.991017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.005515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3baf-215a-480d-8790-ea7c11951813 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:53.012900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:53.013813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:53.014727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:53.014727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:53.014727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:53.014727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:53.017041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 358/729] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:53.023622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.044746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.045373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.045647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.045914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.046744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:53.047047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.048504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.062560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:53.080316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 372/730] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:53.087249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.142565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7150ed8-f00d-4cec-a255-53e73d0a6cf3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.185473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.186916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.188055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.188707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.190885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:53.191595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.193949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.216356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:53.225961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 359/731] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:53.241907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.278162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398f0e-7a3f-401a-a309-6fb64fd34cef None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.349641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c657-6070-4871-b666-3e884cd58773 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.351706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:53.376514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.377174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.377675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.377952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.389930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.390894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.391393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.391898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.400781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.402660 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.404662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.406592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:53.416777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:53.417746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:53.418672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:53.422407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 360/732] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:53.432974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:53.433862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:51:53.434915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:53.436992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.438560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 373/733] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:53.444942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.615256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c256e-5162-4406-9f26-668f72d1ce77 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.641514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64246-e701-47a0-9007-d9d0c7f659cc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.676964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.678003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.678495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.678991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.680037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:53.680557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.682185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.706814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:53.712787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 361/734] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:53.718498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.719438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.719961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.720446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.721915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:53.723050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.723572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.725624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.750593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:53.756254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 374/735] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:53.762295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:53.870988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2948-df19-43e5-b4be-f328990f07bd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.892179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca72a-55d8-4fa7-81bc-149169c8430d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:53.909513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.910587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.911104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.911585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.932828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:53.933389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:53.933664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:53.933931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:53.984569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:53.986361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608deab-01cd-453c-80fb-3b0ae8ca1d1c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:53.995537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.001696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.012850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.014508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.093637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 362/736] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:54.095293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc20e-4eab-413f-b7bd-5ad557b9fcb9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.095769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc20e-4eab-413f-b7bd-5ad557b9fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.096819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc20e-4eab-413f-b7bd-5ad557b9fcb9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.098852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 363/737] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:54.104481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.105092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.105567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.125740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:54.127382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:54.134099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 375/738] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 19:51:54.134958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.200523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 364/739] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:54.201703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.248458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.255442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.271630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3a0c-1839-4fe7-a70e-d1f1c7f7017a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.307917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fc68-0afe-4c9b-9858-8f3167d6a6c3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.309352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.310093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.310367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.310632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.323947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.325503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:54.341817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:54.342748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:54.343634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:54.343634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:54.343634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:54.343634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:54.343634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 376/740] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:54.344459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.349948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.350975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.351470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.351988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.363896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.365710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:54.381559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:54.382478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:54.383402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:54.383402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:54.383402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:54.383402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:54.385952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 365/741] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:54.387011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.460708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9ab7-70ca-45e9-ac94-1d455e27711f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.492506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.500531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.501156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.501428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.501695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.502040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c4f7-2879-4564-8f88-de6472875e82 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.502461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.503936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.521234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.534902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 377/742] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:51:54 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:54.543858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.570331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.570983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.571262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.571591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.572461 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:54.572770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.574275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1701-3e30-4af0-8c0a-c3502887c249 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.588920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 366/743] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:54.590289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fa36-4a4d-4723-9942-788e3dac39a6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.590563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fa36-4a4d-4723-9942-788e3dac39a6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.590891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fa36-4a4d-4723-9942-788e3dac39a6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.596767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 367/744] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:54.597702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fa36-4a4d-4723-9942-788e3dac39a6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.667967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a441-c561-4362-a726-82b3b19a5978 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.709487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.710124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.710492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.710864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.711569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:54.711924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.712302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fa36-4a4d-4723-9942-788e3dac39a6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.713420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2747-e00b-44a5-9dcf-003c063e6caa None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.732005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 378/745] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:54.732005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.732005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.732005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.749606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:54.750903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:54.759612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.761657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.762082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.763598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.771745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.773961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:54.789320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:54.790397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 368/746] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:54.791495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.806331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.830535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:54.850897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 379/747] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 19:51:54.851934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:54.930997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc86c3-5285-4f10-a6b2-a65362af5253 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.975255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:54.975990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:54.976269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:54.976375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a65258-23ac-487a-a08b-98088d3a0006 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:54.976601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:54.984023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:54.985530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:54.998302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:54.999233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:55.000124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 369/748] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:55.000601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.023108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.023750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.024110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.024400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.025380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:55.025688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.027175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.041011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 380/749] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:55.041993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.084382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.094601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.121476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030264eb-9c6d-4ed4-a9ea-b1751b026672 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.148062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85464a58-7136-4a8c-a4e4-e94d692b29e5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.160149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.160854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.161073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.161350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.162006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.163354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025228-6788-450a-893f-7f6ca628c4d2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 370/750] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:51:54 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12955d5-811d-4970-8dbe-26ad0b878928 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12955d5-811d-4970-8dbe-26ad0b878928 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12955d5-811d-4970-8dbe-26ad0b878928 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 371/751] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:55.191893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12955d5-811d-4970-8dbe-26ad0b878928 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.210349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.215175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7de2-9b78-49fb-a7a6-d55e9b9e7c93 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.228788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 381/752] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:55.230201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.230554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.230930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.250886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:55.252411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:55.341586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 382/753] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:51:55.341883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12955d5-811d-4970-8dbe-26ad0b878928 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.342824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.380810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.392364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.394928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.394928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.395211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.396566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=05de568d5ff94ae6a72ce2d795e408de) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:55.397151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.398878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.399591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.408533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 372/754] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/role_assignments?user.id=05de568d5ff94ae6a72ce2d795e408de&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:55.409634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.509236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fce9e-19a4-44b7-9251-1eeaeaa2c416 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.543648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358affe-617f-4c95-995e-af31c334a46c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.566728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.567509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.568006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.569347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.570195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=00947bb45d374dbba13ef2e02b9ce1f8) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:55.572167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.574477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.586373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 383/755] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/role_assignments?user.id=00947bb45d374dbba13ef2e02b9ce1f8&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:55.595228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.597032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.597529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.598037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.611435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:55.619128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:55.620241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:55.621107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:55.623988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 373/756] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:55.629901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.768887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.773232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda4ef3-a038-4e27-99ea-5c274b9ad40b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.815173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.816193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.816699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.817188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.818127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:55.818645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:55.820306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:55.829482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 384/757] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:55.835035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:55.898668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:55.948332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94ddc-64c9-4de8-b5c3-714c136d3740 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:55.983891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:55.984946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:55.985441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:55.985906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:55.998200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:56.000086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:56.015649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:56.016654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:56.017590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:56.017590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:56.017590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:56.017590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:56.020461 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 374/758] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:56.028898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:56.156377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7f33-0edd-4440-9db0-7c6ef6d301df None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:56.199718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:56.200723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.201203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.201693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.202585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:56.203102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:56.204727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:56.226364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 385/759] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:56.231633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:56.391693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87195c-b310-4787-a7dd-04789c0bd774 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:56.401533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:56.454849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:56.455551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.455846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.456262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.467636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:56.469118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:56.487659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:56.488681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:56.489636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 375/760] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:51:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:56.496861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:56.542651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:56.652567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508de52-77e0-4cc2-860e-a03b440c06a4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:56.698149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:56.698807 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.699084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.699356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.700222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:56.700530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:56.702014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9f712-8cc1-4720-9f1d-82b028838602 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:56.731230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 386/761] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:51:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:56.737353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:56.895228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245edbe8-2e1e-4a36-bfba-1fb4de41d879 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:56.940552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:56.941194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.941465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.941727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.955592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:56.957228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:56.967527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183e65-b006-409d-a0c8-b0c39e0fc001 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.968180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183e65-b006-409d-a0c8-b0c39e0fc001 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.968180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183e65-b006-409d-a0c8-b0c39e0fc001 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.970664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 387/762] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:51:56.974968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:56.975418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:56.975693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:56.980311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:56.982235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:56.984051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:56.984051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:56.984051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:56.984051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:56.984051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 376/763] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:56.988977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.012238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:57.013422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:57.029827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:57.153331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 388/764] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:51:57.177270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc7149-55f4-4314-81aa-f17af28157a2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.191951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.204141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:57.237433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.238244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.238519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.238806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.239478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:57.239772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.245922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:57.266960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 377/765] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:57.273507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.334169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733499-3c5e-4811-8da1-3ca75d7f4f8d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.377995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:57.403667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d58bf-3ea1-40c1-922f-a9ba12e7ff49 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.457159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.458176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.458665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.459130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.466476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.468156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:57.472521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.473371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.473650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.473921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.474563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.475940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:51:57.482335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:57.483227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:51:57.484223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:57.487430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 378/766] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:57.494511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:57.495425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:51:57.496303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:57.499804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 389/767] 10.222.0.95 () {56 vars in 1129 bytes} [Fri Aug 5 19:51:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:51:57.500635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.505407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.664935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:57.693452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c345-5de3-4115-8cdd-c14f0a436a60 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.726546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed46e4-650a-4376-89e7-6a9f10ca636f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.770505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.771511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.772029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.772504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.773475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:57.775666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.777324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:57.796510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:57.804546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.807555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.808189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.809754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.812102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:57.813482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.813714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 379/768] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:57.815563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:57.819063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.825849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 390/769] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:51:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:57.831602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:57.947369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d71c-d4f5-41e8-9cd7-2092848d1ba9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.982248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7b95-67c9-4bfc-bfd9-2426c66b1342 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:57.988372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:57.989643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:57.990129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:57.990625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:57.991621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:57.992180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:57.993758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318683f-a24e-4242-b0eb-60e599ee97ef None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.000499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 391/770] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:51:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:58.002518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7442-cf50-4a1f-b2f6-3cc83b0ece73 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.003006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7442-cf50-4a1f-b2f6-3cc83b0ece73 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.003543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7442-cf50-4a1f-b2f6-3cc83b0ece73 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.005299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 392/771] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:58.006704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7442-cf50-4a1f-b2f6-3cc83b0ece73 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.010403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.026267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.026944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.027215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.027495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.029502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=b7f6f07c961a46329912067a520beae1, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.031181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f98f5b-97ee-4558-863f-e0c106e75693 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.046719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 380/772] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:51:57 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:51:58.048282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b694a2-51ce-4e0b-a98e-0ae2277cf23d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.048513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b694a2-51ce-4e0b-a98e-0ae2277cf23d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.049358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b694a2-51ce-4e0b-a98e-0ae2277cf23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.071762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-62b694a2-51ce-4e0b-a98e-0ae2277cf23d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:58.073177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-62b694a2-51ce-4e0b-a98e-0ae2277cf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:58.132372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7442-cf50-4a1f-b2f6-3cc83b0ece73 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.140106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.160924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 381/773] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb931-3b73-4e11-b71f-62f86945d183 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb931-3b73-4e11-b71f-62f86945d183 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb931-3b73-4e11-b71f-62f86945d183 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 382/774] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fd5e-2f48-40ba-baff-5c3a10cc87ee None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.166163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fd5e-2f48-40ba-baff-5c3a10cc87ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.166650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77fd5e-2f48-40ba-baff-5c3a10cc87ee None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.172128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 383/775] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:51:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:51:58.173690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.174252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.174505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.180886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.181613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.181944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.182218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.182991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] RBAC: Adding query filter params (interface=public, service_id=6b35008d22d546ffb09b60413072472d, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:58.183347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.184870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a413c9-3092-423a-abdb-3d9b7ae67b9f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.193854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 393/776] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/endpoints?service_id=6b35008d22d546ffb09b60413072472d&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:51:58.195209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.195499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.195769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.200196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:58.201488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:58.218122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:51:58.219346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:51:58.285447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 384/777] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:51:58.286288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.292139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.307385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 394/778] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:51:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:51:58.308597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.402245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e8a24-5f2f-47af-8372-a16803ef754b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.429297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c326a6-70ad-4327-a5c6-5fd9eddb7b74 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.430640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.451245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.451969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.452185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.452449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.453132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.454406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.467056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:58.467455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:58.468509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:51:58.469356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:58.470095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.470095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.470095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.470287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 385/779] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:58.470287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.474403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.475803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.481231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 395/780] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:58.482000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.565112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.621325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac731-c6e7-4652-87e5-415c6425c3f2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.625385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843940-6ca2-4664-8ecd-b87ef285fdf5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.665130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.666102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.666213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.666678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.666965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.667251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.667522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.667808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.679468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:58.680297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:58.685224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:58.686199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:51:58.687289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:51:58.687947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:58.688846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:51:58.690460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:58.696614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 396/781] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:58.696614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.696932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 386/782] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:58.696932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.747626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.813878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db08bd-998c-4e43-9a7d-6a44ab49f205 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.817773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72853-1e4b-4adb-a173-bf06d2e89e70 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.840969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:58.857226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.858132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.858600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.859041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.859983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:58.860428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.861862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:58.862288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.862778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:58.863130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:58.863474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:58.864388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:58.864772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:58.866296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:58.871802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 397/783] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:58.872775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.873241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 387/784] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:58.877540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:58.985759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a69d4e-7d6d-4b7c-bff1-f2e72080b0e1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.988954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5075c6-ba5c-4914-aa40-468c974c3f2a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:58.992300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.027435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.028767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.029087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.029406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.030091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.030203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.030576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.030947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.031376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:59.031828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:59.031974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.032316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.034001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.034133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.039621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 388/785] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.040526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.047971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 398/786] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.049675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.099971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.147763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba898f-7300-4185-bf0b-c30abb386e6a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.161427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6637d6-b4c3-45a3-acbd-3aec65635937 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.183101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.183938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.184314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.184680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.198593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.200304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.200620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.201617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.202053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.202586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.203595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] RBAC: Adding query filter params (interface=public, service_id=ed8b90f15cf04aaaadd8be25d86ad990, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:59.204086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.205706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.212550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 399/787] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/endpoints?service_id=ed8b90f15cf04aaaadd8be25d86ad990&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.213609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:59.217668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:59.218748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:59.219872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:59.219872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:59.219872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:59.219872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:59.221229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 389/788] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:59.222065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.256229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.334801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa42b-4aab-454e-b031-2da73f43a802 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.337884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a72be-3d97-4425-89ed-2228f005b4a0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.348155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.376363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.377063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.377345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.377699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.382581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.383437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.383970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.384437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.385286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.386985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.390126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.391884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.393718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 390/789] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.394821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:51:59.410966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:59.412039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:59.413104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:51:59.413104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:51:59.413104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:51:59.413104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:59.413104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 400/790] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:59.420260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.507463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.529909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86e4e2-4d95-4f06-88b9-81f19b3d0d10 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.601916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.602557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.602830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.603103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.603848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:59.604156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.605509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.613478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac730a-9689-4bd2-b60c-d00c183089ed None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.619587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 391/791] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.625641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.666219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.667318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.667600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.667916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.668914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:51:59.669221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.670908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.688373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 401/792] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:51:59.695615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.735803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.782645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671aef3-ebfd-4b2d-8493-3d79eafd2888 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.820385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.821036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.821359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.821636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.829227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.831797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.833623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eacb3-7727-49b0-a226-81a05136a062 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:59.844964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:59.846362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:51:59.847280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 392/793] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:59.852992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:51:59.856874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:51:59.881777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:51:59.882973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:51:59.883446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:51:59.883998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:51:59.892732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:51:59.894619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:51:59.908385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:51:59.909430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:51:59.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:51:59.913338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 402/794] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:51:59.919893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.019586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568e852-5bc3-43f3-89f0-8b32d9c93bdf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.020932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.045081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d6cd-8e92-406d-898c-7914fb44ed21 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.093860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.095929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.097029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.097550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.098357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.098831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.101113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.101411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:00.101924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.103401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.104452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:00.105181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.105714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.109080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.146011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 393/795] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:00.151496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.152626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 403/796] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:51:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:00.158816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.269680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.337248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fac14-dd15-4afd-bb5f-60a0139b9c16 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.374046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25f43c-8824-4458-878f-324e22fbe68d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.381984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.386881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.387425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.387994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.415357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.420031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:00.452168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:00.453104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:00.453976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:00.453976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:00.453976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:00.453976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:00.462113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 394/797] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:00.464847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.465791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.466819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.467681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.468591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.489892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.494255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.496689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5ea096ac-acf2-4cc6-832f-8913824c8ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:00.522761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:00.523739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:00.524630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:00.524630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:00.524630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:00.524630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:00.524630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 404/798] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:00.525441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4e0a-d301-48eb-b9c4-11be2c2f9130 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.525720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4e0a-d301-48eb-b9c4-11be2c2f9130 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.525986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4e0a-d301-48eb-b9c4-11be2c2f9130 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.531650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 405/799] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:00.532876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4e0a-d301-48eb-b9c4-11be2c2f9130 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.604378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d718b-a572-4957-b2cc-f4351338529c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.622037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.643280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4e0a-d301-48eb-b9c4-11be2c2f9130 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.648304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.649252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.649769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.650297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.651311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:00.651838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.653492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2529c22-3052-407f-8cb2-7809a88cb8d2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.672189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 395/800] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:00.674528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.675022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.675616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.678819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.679553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.679882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.680154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.680845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:00.681199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.682540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.695395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 406/801] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:00.696401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.697404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:00.698987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:00.749900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.788160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 396/802] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:00.789508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.807827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb51f3c-47f6-41bb-999a-f558d0d1b377 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.835848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.836491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.836770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.837197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.844097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.846172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:00.858239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:00.859229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:00.860176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 407/803] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:00.864873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:00.935615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140b90-d1aa-4407-bdf9-161b011ff353 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.940067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.970833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cade-bfcc-4934-8bd7-daf9eecbcdb8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:00.976549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:00.977243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:00.977527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:00.977921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:00.983901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:00.987416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:00.988927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:01.000599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:01.001693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:01.002593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 397/804] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:01.003076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.012714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.013356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.013633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.013904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.024354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2e0271f9-b6b3-41c8-a255-841441a77831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:01.029948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:01.030885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:01.031732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 408/805] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:01.033468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62232b-e950-418f-bddd-95577b1703e8 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.033468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62232b-e950-418f-bddd-95577b1703e8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.033468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62232b-e950-418f-bddd-95577b1703e8 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.034777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 409/806] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:01.039514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62232b-e950-418f-bddd-95577b1703e8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.121259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4ea4-7c3e-4197-9f74-a875773bb217 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.151385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62232b-e950-418f-bddd-95577b1703e8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.160559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.161179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.161455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.161724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.162472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:01.162775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.164228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.182182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 398/807] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:01.182182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.192920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.193546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.193879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.194161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.194912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:01.195473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.196671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460be27-c040-4043-a42e-d93c84a43829 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.210751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 410/808] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:01.212021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.212305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.212577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.216492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.233683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:01.234873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:01.262142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.302254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff19ce-9ae3-4cbc-8364-85de9d51675c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.307265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 411/809] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:01.307973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.348755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.349379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.349721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.350091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.351066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:01.351372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.352764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.361834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 399/810] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:01.364712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.426046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9210-ec4e-4b0a-a0b1-bb3facade077 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.466530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.467209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.467479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.467751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/00947bb45d374dbba13ef2e02b9ce1f8/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.474073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.484237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=00947bb45d374dbba13ef2e02b9ce1f8, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.486057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.490463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4b86-c1ad-4d7e-b129-81f3e250fcc9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.499427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 412/811] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:01 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/00947bb45d374dbba13ef2e02b9ce1f8/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:52:01.500496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.522190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.547710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.548606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.549100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.549548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/05de568d5ff94ae6a72ce2d795e408de/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.551941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=05de568d5ff94ae6a72ce2d795e408de, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.556587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.580861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 400/812] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:01 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/05de568d5ff94ae6a72ce2d795e408de/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:52:01.582402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.683073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451e839-0253-4e77-bf16-2c4a84278f0f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.734849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.735529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.736361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.736645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.737291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.738670 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:01.752638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:01.753617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:01.754451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 413/813] 10.222.0.95 () {56 vars in 1129 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:01.760253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.775149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490084e1-dd54-46c9-8c84-5ea2adb22489 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.818767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.819375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.819649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.819939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.843387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.844863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.852670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ecd61097-ad17-4bef-b126-6e5bcfdd74fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:01.861691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:01.862867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:01.863977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:01.863977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:01.863977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:01.863977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:01.865646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:01.869605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 401/814] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:01.869605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59fb1-3c9c-460a-8daf-aa1ec4a5252d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.869605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59fb1-3c9c-460a-8daf-aa1ec4a5252d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.869605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59fb1-3c9c-460a-8daf-aa1ec4a5252d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.871158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 402/815] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:01.873738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59fb1-3c9c-460a-8daf-aa1ec4a5252d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:01.897946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d819d9-4377-4f9c-8031-56044feac2f1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:01.940457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:01.941590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.942396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.942828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.943971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:01.944443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:01.946405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bae7-0fdf-44f9-b77c-6f03ebe6e638 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:01.952508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 414/816] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:01.955177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:01.955936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:01.956380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:01.982187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:01.983953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:02.009821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59fb1-3c9c-460a-8daf-aa1ec4a5252d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.059229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.060592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.060947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.061283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.062370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:02.062688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.065901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.088068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 403/818] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:02.088068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.088323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 415/818] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:02.099109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.181432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.190098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.222365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532f00c-f190-4817-82ac-739ba368d254 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.231623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c1d8-21c1-4318-9297-c8e818c6af2a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.258329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.259152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.259471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.259862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.268292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.270069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.272968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.273790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.274222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.274633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.275451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:02.276026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.277598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:02.283946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:02.285097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:02.286321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:02.286965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 404/819] 10.222.0.95 () {56 vars in 1124 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:02.292485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 416/820] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:02.292614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.293359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.396199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969a23-55a6-4719-8844-a03503a9da96 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.410202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98648cc-0179-41cd-98db-668d3097ff4a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.431048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.439084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.440165 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.440555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.440918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.441771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.443451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.454738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.473967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 417/821] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:02.475251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.481652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.482478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.482880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.483252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] PATH_INFO: `/v3/services/network` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.484066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.485660 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:02.498379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:02.499665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 19:52:02.500725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:02.508173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 405/822] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:02.509631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.666420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934aa19-b5f7-452b-b4e3-05121c248665 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.703257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2e77e-4ed6-4a2e-879b-174e15f36f29 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.721386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.722153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.722519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.723131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.723666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] RBAC: Adding query filter params (name=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:02.724086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.725544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.731264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 406/823] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:02.741602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.761518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.762157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.762429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.762698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.763503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:02.763837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.765257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:02.786862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 418/824] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:02.793249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:02.833542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.854012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:02.942555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bf64-48fc-45f7-b23a-3937aefaa33b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.953779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cea2-f347-4f96-b5b2-4582322a6c78 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:02.986399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:02.987039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:02.987313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:02.987580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:02.988283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:02.988582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:02.989930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:03.005064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 407/825] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:03.010596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:03.023597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:03.024256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.024530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.024798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.122529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:03.124393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:03.211104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:03.227835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d015182-eb6b-485c-8bdb-64998592a3e1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:03.255288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:03.293655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:03.294284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.294557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.294824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.295533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:03.296910 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:03.307201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 419/826] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 19:52:03.315592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:03.326464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 408/827] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:03.477061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03d5cf-069e-43a2-a6ff-dca54a2fe0b5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:03.528702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:03.529612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.529892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.530163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.539577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:03.543987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:03.545597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:03.572853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:03.574013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:03.575088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:03.575088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:03.575088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:03.575088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:03.575088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 420/828] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:03.581712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:03.718404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4519a1-d1bb-4b06-a7a2-e88fa50b2f5a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:03.758812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:03.759369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.759643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.759945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.760643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:03.760942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:03.762313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6584-d943-4395-ac01-08b505483d7a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:03.776821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 409/829] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:03.783095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:03.820706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bc32-6986-4ad6-9a7f-673380795a0a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.821066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bc32-6986-4ad6-9a7f-673380795a0a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.821242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72bc32-6986-4ad6-9a7f-673380795a0a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.822846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 410/830] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:03.827932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49285-6a73-4cea-9abc-71d58fce9693 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.828219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49285-6a73-4cea-9abc-71d58fce9693 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.828496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49285-6a73-4cea-9abc-71d58fce9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.849552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-71f49285-6a73-4cea-9abc-71d58fce9693 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:03.850866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-71f49285-6a73-4cea-9abc-71d58fce9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:03.881094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:03.937969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929dc46-61e6-4a75-959e-4cf480408140 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:03.941967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 411/831] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:03.949317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755113b9-1075-4b91-a935-e546e7144226 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.949587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755113b9-1075-4b91-a935-e546e7144226 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.949861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755113b9-1075-4b91-a935-e546e7144226 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.952400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 412/832] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:03.957105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69257-0079-436a-add8-1346b67bd665 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.957459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69257-0079-436a-add8-1346b67bd665 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.957650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69257-0079-436a-add8-1346b67bd665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.977510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-55a69257-0079-436a-add8-1346b67bd665 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:03.978735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-55a69257-0079-436a-add8-1346b67bd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:03.979349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:03.980034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:03.980312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:03.980580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:03.990134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:03.992403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:04.010901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:04.016853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 421/833] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:04.017769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.055021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 413/834] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:04.056193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69257-0079-436a-add8-1346b67bd665 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.081017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.134143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68230ecd-ba3c-4dd1-882d-92afbcfad2b2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.152216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.173516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.174199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69257-0079-436a-add8-1346b67bd665 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.174345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.174660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.175087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.187143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:04.192961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:04.194114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:52:04.195153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:04.195958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 422/835] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:04.196679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.214742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.215444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.215829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.216166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.216977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.217350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.218831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.231662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 414/836] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:04.237332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.308795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998641e-e77d-4346-af4b-b26627032491 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.321846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.346410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.347056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.347336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.347609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.350095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebccd1d-725f-4464-8e6b-592ac34a4b14 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.358615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:04.368024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:04.369166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 423/837] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:04.375183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.387235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.387865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.388146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.388419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.389137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.389437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.390780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.403897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 415/838] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:04.403897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.415666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.494768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad9d8-91b4-49b4-86a6-bc5daef31a22 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.517722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849cb70-433f-4f04-9bbc-34cd3f6b583b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.531599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.532340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.532637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.532903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.533700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.534000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.535421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.541564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 424/839] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:04.542366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.568518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.569521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.570037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.570636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.571729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.572289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.573907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.597141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 416/840] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:04.599395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.603429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.682910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa47d-6e9f-4faa-9123-afdbe2cb361b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.688971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.723470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.724326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.724695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.725068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.728599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ca95-c6ab-4901-8e03-dfe36c189103 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.736836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.738287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:04.754450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:04.755359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:04.756533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:04.756533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:04.756533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:04.756533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:04.756533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 425/841] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:04.761996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.776281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.776992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.777283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.777553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.791574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.793060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:04.808728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:04.809706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:04.810630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:04.810630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:04.810630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:04.810630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:04.810630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 417/842] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:04.818731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.869502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.883224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9942-2e57-4a9b-b4a8-2717a078048f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.933426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.934108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.934212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05180dbd-16ef-4813-9b63-13ef57e74efd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:04.934385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.934650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.935391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.935982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.938157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54143c-7dc4-4318-95f0-932798c2d035 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.951522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 426/843] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:04.952611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55816-a2c0-422e-8bf8-c19bb0e75bd5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.952894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55816-a2c0-422e-8bf8-c19bb0e75bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.953162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55816-a2c0-422e-8bf8-c19bb0e75bd5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.955117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 427/844] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:04.958100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55816-a2c0-422e-8bf8-c19bb0e75bd5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:04.963151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:04.977511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:04.978298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.978683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.979007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:04.979710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:04.980042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:04.981545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1468-d284-4026-af21-a6744b4819eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:04.996503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 418/845] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:04.997616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:04.997895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:04.998169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.020522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:05.021717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:05.070266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55816-a2c0-422e-8bf8-c19bb0e75bd5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.095741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 419/846] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:05.096845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.119973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.120636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.120918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.121293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.130694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.135811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:05.149248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:05.150197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:05.151138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 428/847] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:52:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:05.151715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.166535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.214473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85c83-8691-4236-8968-bf7dace1b56f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.229132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.252658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.253310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.253573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.253848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.261591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.263013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.270384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b21e-eb7d-4e9a-87b0-8720f34d738e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:05.276147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:05.277087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:05.278006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 420/848] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:05.278587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.317166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.318452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.318927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.319397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.320228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.322237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:05.335442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:05.336511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:05.337325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:05.338042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 429/849] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:05.338648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.392493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6042c-d76d-4be7-a8db-132d99a7f260 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.415869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.441416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.442064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.442511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.442788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.443594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:05.443942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.445435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.453297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89776-c9fd-499c-86c4-7b30cc401826 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.464869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 421/850] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:05.465986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.493829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.494440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.494712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.494981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.495766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:05.496090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.497491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.498319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.523095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 430/851] 10.222.0.95 () {56 vars in 1135 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:05.523095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.576016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cd0d-e107-4439-94ac-72e0d866b1de None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.612091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.612717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.612994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.613263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.614026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:05.614234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.615581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.620224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 422/852] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:05.620834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.637408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76aa21-beba-4935-8b1b-29152350d3b6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.667205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.673956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.674579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.674854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.675118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.726180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.734381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f220-537f-47e0-839e-587b48c66f8b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:05.748773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.750208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.774112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:05.774734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:05.775017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:05.775284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:05.851879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:05.853740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:05.865011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 431/853] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:05.865011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.895152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.958838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:05.971157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 423/854] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:05.971157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:05.979674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad77ba-fcb8-472f-8ee8-091a936cb6da None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.018698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.019340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.019696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.020097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.020888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.021193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.022548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.029662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 432/855] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:06.030442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.094107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f10d3-33bf-4513-88a3-dfecc3e32ef7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.138416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.138995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.139271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.139548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.140352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.148807 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8f550-6a85-4b77-b411-7a6de72e9287 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.153701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.155457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:06.174282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:06.175266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:06.176191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:06.176191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:06.176191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:06.176191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:06.180251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 424/856] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:06.181740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.193528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.194183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.194459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.194748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.206440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.208129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:06.225490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:06.226432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:06.227296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:06.227296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:06.227296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:06.227296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:06.230362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 433/857] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:06.232573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.237170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.310025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7863-ab71-48d5-80ee-7299149e769b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.348850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144630a-6f13-4cfd-bbb9-442101d91ed0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.356860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.357536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.357817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.358086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.359306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.359617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.361051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.379818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 425/858] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:06.383942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.395378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.395993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.396767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.396767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.397372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.397674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.399420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.417666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 434/859] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:06.426063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.438027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.544744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a697-4d91-4662-bac2-d5a3937c2611 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.545915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6e660-1466-42d3-b6ad-5e348f350926 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.554714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.584449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.585095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.585369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.585635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.593259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.593415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.594354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.594789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.595200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.595821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.604476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.606165 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:06.607137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:06.608118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:06.609010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:06.613697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 426/860] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:06.614559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:06.624973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:06.625963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:06.626993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:06.634648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 435/861] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:06.635827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.713468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.752617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2861d4-6e03-4df7-8b99-b2e8adfff7ac None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.757439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997166-aa53-4966-9851-bbb02ec2a7a7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.789571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.790189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.790464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.790733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.791476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.791819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.793210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21cda1-6c05-4490-a093-4f7a763855a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.803195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.803850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.804136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.804400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.805157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.805463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.813886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 436/862] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:06.814073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d99e-1b88-4a64-85c1-20aa2a3f06d8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.814152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab26e-9827-4173-a757-696c1a62e2c3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.814152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab26e-9827-4173-a757-696c1a62e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.814152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab26e-9827-4173-a757-696c1a62e2c3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.814152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 437/863] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:06.814152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ab26e-9827-4173-a757-696c1a62e2c3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.833928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 427/864] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:06.833928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.833928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.833928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.850768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:06.851973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:06.873378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.924899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 428/865] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:06.926070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:06.940574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ab26e-9827-4173-a757-696c1a62e2c3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:06.968342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:06.980445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:06.981058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:06.981334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:06.981639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:06.982615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=05de568d5ff94ae6a72ce2d795e408de) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:06.982725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:06.984180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:06.995827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 438/866] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/role_assignments?user.id=05de568d5ff94ae6a72ce2d795e408de&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:06.995827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:07.070706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22c94c-0b20-4178-97a8-fca264439f96 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:07.113690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:07.114319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:07.114588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:07.114851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:07.115663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=00947bb45d374dbba13ef2e02b9ce1f8) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:07.117222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:07.118724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:07.127106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 429/867] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/role_assignments?user.id=00947bb45d374dbba13ef2e02b9ce1f8&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:07.135205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b718e8-f45a-47c2-9101-f9eabdd00285 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:07.180243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:07.181244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:07.181754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:07.182242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:07.183102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:07.184692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:07.202605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:07.205064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:07.207398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:07.214364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 439/868] 10.222.0.95 () {56 vars in 1132 bytes} [Fri Aug 5 19:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:07.217780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:07.247144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:07.336157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986894-effa-4bcf-a890-2034e9eff4b5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:07.371681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:07.372662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:07.373131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:07.373672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:07.374539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:07.375033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:07.376878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52f122-60d9-4354-a83f-6e02569f5a1b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:07.382438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 430/869] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:07.387978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:07.451565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:07.500174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f220d-c79a-488b-92d0-839ed936e31f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:07.535437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:07.536101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:07.536377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:07.536644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:07.537332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:07.537631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:07.538984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e4742-91b6-480a-a558-7a4fa80c24d0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:07.544012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 440/870] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:08.190666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac294-e109-4abe-8ffb-307e57b18da4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:08.191061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac294-e109-4abe-8ffb-307e57b18da4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:08.191255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac294-e109-4abe-8ffb-307e57b18da4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:08.192923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 431/871] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:08.198270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232394-6b15-449d-b8e4-eea076f2bf5a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:08.198561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232394-6b15-449d-b8e4-eea076f2bf5a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:08.198840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232394-6b15-449d-b8e4-eea076f2bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:08.220007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e9232394-6b15-449d-b8e4-eea076f2bf5a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:08.221349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e9232394-6b15-449d-b8e4-eea076f2bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:08.292419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 441/872] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:08.315493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac294-e109-4abe-8ffb-307e57b18da4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:08.412111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:08.440824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac294-e109-4abe-8ffb-307e57b18da4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:08.476800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:08.477745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:08.478239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:08.478718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:08.479604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:08.481261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d658-87d2-4ddf-b5f9-dbc7d4d9c673 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:08.499751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 432/873] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:08 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:09.152612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91012-2f5b-4a82-b321-97a1146351aa None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.153878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91012-2f5b-4a82-b321-97a1146351aa None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.154357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91012-2f5b-4a82-b321-97a1146351aa None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.156220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 442/874] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:09.162233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2ab7-647a-4f39-981a-40e23859d9d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.162816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2ab7-647a-4f39-981a-40e23859d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.163304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2ab7-647a-4f39-981a-40e23859d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.182128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ba5e2ab7-647a-4f39-981a-40e23859d9d7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:09.183630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba5e2ab7-647a-4f39-981a-40e23859d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:09.267015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 433/875] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:09.289416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac91012-2f5b-4a82-b321-97a1146351aa None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.345093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef4a7-7d6e-42c0-975b-451126518e35 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.345441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef4a7-7d6e-42c0-975b-451126518e35 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.345639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef4a7-7d6e-42c0-975b-451126518e35 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.345763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:09.347421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 434/876] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:09.353283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607069-7130-4574-a372-e4ff453b904d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.353564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607069-7130-4574-a372-e4ff453b904d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.353839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607069-7130-4574-a372-e4ff453b904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.373624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2a607069-7130-4574-a372-e4ff453b904d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:09.374815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2a607069-7130-4574-a372-e4ff453b904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:09.402010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac91012-2f5b-4a82-b321-97a1146351aa None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.444706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:09.445438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.445716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.446053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.446658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:09.448203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:09.458177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:09.459151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:09.465250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 443/877] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:09.466027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.476861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:09.483434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 435/878] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:09.509004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607069-7130-4574-a372-e4ff453b904d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.604235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8bbd1-5f7e-4f53-880f-4daf074c33b9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.619367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607069-7130-4574-a372-e4ff453b904d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.623685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:09.651408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:09.652070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.652359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.652631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.653306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:09.653865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:09.655248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787030b-2745-4bd7-b351-694ab32aea54 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:09.659323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:09.660000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.660292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.660552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.666249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 444/879] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:09.666249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80aa4-7715-48b7-ba8f-fcf0a3df5052 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.666249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80aa4-7715-48b7-ba8f-fcf0a3df5052 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.666249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80aa4-7715-48b7-ba8f-fcf0a3df5052 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.666249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 445/880] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:09.666992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80aa4-7715-48b7-ba8f-fcf0a3df5052 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.678944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f222a6b6-6a6f-4b6d-9ccc-7a3a6704be45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:09.684005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:09.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:09.685853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 436/881] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:09.692119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.692406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.692682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.712295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:09.714070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:09.775429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:09.786697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80aa4-7715-48b7-ba8f-fcf0a3df5052 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.791283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 437/882] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:09.792630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.833140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:09.834333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.834653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.834926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.835604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:09.835951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:09.838250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:09.843928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 446/883] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:09.844900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:09.896393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:09.935049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df1ac5-43d8-4b98-87fb-cd32cf45edae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.966035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d54d0-8d59-4427-8839-46c3a4906605 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:09.987120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:09.988592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:09.989051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:09.989512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:09.990444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:09.990951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:09.994204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.011273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 438/884] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:10.011884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.014977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.015624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.016028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.016436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.017223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.018581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.039543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 447/885] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:09 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:10.083647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:10.141907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f00e-f8e4-4616-98ef-639517b22582 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.190161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.190902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.191181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.191444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.203074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.205417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:10.221751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:10.222696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:10.223622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:10.223622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:10.223622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:10.223622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:10.223622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 439/886] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:10.228608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.341161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:10.344944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f010ed-178f-4dc6-8f0a-f6d011813861 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.381497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.382122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.382398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.382748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.383363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:10.383661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.385042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.397978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 448/887] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:10.403688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.516407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf24de-2c45-4cfb-ac2f-4125fee93b41 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.527722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:10.552854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.553506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.553781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.554051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.562098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.563920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-43e2da46-582e-49f9-96dd-27d538c1677b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:10.575858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:10.576838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:10.577860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 440/888] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:10.583016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.606610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6fe96-3b66-41ab-924a-d3d144ebe322 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.606925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6fe96-3b66-41ab-924a-d3d144ebe322 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.607152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6fe96-3b66-41ab-924a-d3d144ebe322 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.612902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 441/889] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:10.614659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.614946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.615221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.634729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:10.636015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:10.709527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 442/890] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:10.712075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267d01-ce43-46ff-a116-24748eaae492 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.732508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.749763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.751484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.751765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.752059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.753158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:10.753464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.754888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.778241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 449/891] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:10.784003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.802937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:10.832920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:10.844866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f670c44-439e-4f03-9f29-406979dc037a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.883600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.884677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.885148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.885561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:10.886363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:10.888069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:10.897346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b3bcb-13c0-4025-8dd6-c38c8376426a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:10.898222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:10.899383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:10.900353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:10.907981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 443/892] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:10.910027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:10.935089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:10.935552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:10.935862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:10.936135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.016910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.018460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.026811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff248f-5af5-457a-8f1c-526ed707cd20 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.038424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.068744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.069649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.070105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.070615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.071573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:11.072047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.073605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.084564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 444/893] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:11.086099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.109457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.147224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 450/894] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:10 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 19:52:11.148504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.218881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221d9d-db89-4b9d-985e-46468bed78a6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.256723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.257150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.257426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.257697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.258387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:11.258688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.260137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.267371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 445/895] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:11.272770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.274625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73bbb0-b878-42d9-ae0f-bd033adf8de1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.298118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.327231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.328385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.328891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.329720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.343392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.346132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:11.365877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:11.367013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:11.368084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:11.368084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:11.368084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:11.368084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:11.371879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 451/896] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:11.372941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.373063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.395487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b04f7-6580-48d3-a6cd-bef82109c768 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.448643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.449747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.450204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.450752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.452012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] RBAC: Adding query filter params (interface=public, service_id=0b1aba2553084833824c6cae5abc22dd, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:11.452730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.455108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.465298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 446/897] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/endpoints?service_id=0b1aba2553084833824c6cae5abc22dd&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:11.471720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.503990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7f22-840b-4546-bb8a-7cd65fe221ec None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.550860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.551411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.551688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.551989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.552686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:11.552989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.554344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.567338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 452/898] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:11.573745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.611575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2fcb8-db62-4e04-87d7-3d9ad39a9085 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.617933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.649198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.649823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.650099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.650368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.651027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.652531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.663990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 447/899] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:11.707673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535276-969a-40e7-ba3c-a21878b7fc03 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.749295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.750504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.750992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.751425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.759587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.761328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:11.774646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:11.775919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:11.777096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:11.783908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 453/900] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:11.786260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:11.801356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:11.909284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415d50-65a1-4a41-92d5-a02fcf395d0f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:11.963858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:11.963858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:11.963858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:11.963858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:11.964308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:11.964308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:11.964308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb9a24-14c9-44ef-830d-c358792309a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:11.980032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 448/901] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:11.986469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.009828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e57601-0859-40cb-a068-1937152d95c3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.010179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e57601-0859-40cb-a068-1937152d95c3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.010372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e57601-0859-40cb-a068-1937152d95c3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.012005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 449/902] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:12.017891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.018172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.018445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.038824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:12.040166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:12.091927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:12.105682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5945-d145-4a5b-8513-2c8eca04d3f6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:12.125678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:12.137842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 450/903] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:12.147123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:12.147749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.148065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.148340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.149190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] RBAC: Adding query filter params (role.id=04bef4b935114c4897b720fa84421f4d, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=00947bb45d374dbba13ef2e02b9ce1f8) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:12.149533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:12.150975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f00108-f385-4093-81b9-5a662b6ab608 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:12.158221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 454/904] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:11 2022] GET /identity/v3/role_assignments?user.id=00947bb45d374dbba13ef2e02b9ce1f8&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=04bef4b935114c4897b720fa84421f4d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:12.158723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.235564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2e0d-55bd-490f-b4c7-7568b1d571c1 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.235875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2e0d-55bd-490f-b4c7-7568b1d571c1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.236149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2e0d-55bd-490f-b4c7-7568b1d571c1 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.238025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 455/905] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:12.243474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.243900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.244279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.263741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:12.265242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:12.277609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae79e72-f488-475b-ac7a-9c6f45afd429 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:12.325494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:12.326326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.326797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.327200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.328111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:12.329571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:12.344326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 456/906] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:12.358172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 451/907] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:12 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:12.368410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.467419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:12.485772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a58b8-2964-471c-8acb-540175f5d2be None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:12.530389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:12.531035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.531342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.531610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.532250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:12.533586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:12.542837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:12.543933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:12.545887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 457/908] 10.222.0.95 () {56 vars in 1132 bytes} [Fri Aug 5 19:52:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:12.550943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.616767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:12.665680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d0ae-afb6-4c80-b179-489ff0da2d6b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:12.702394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:12.704019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.704512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.705007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.705904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:12.706427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:12.708074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:12.714299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 452/909] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:12.721107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.825129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2aea1-e2d9-409c-a267-6ecbb69f550e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:12.864108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:12.864733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:12.865097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:12.865429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:12.866051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:12.866348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:12.867753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:12.873592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 458/910] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:12.880092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:12.999517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52140f-230a-4508-b29a-2b3c00b8ac71 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:13.024982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:13.037933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:13.038827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:13.039365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:13.039889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:13.040878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] RBAC: Adding query filter params (interface=public, service_id=5d9072c063d54cdbb1f2c6d35ee27399, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:13.041399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:13.042984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf2280-5df1-4d6b-ba5d-be2daf67fb92 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:13.049033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 453/911] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:52:12 2022] GET /identity/v3/endpoints?service_id=5d9072c063d54cdbb1f2c6d35ee27399&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:13.056604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:13.066347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:13.161696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118bc4-6778-4e5f-be05-aa42d10d4bfd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:13.196409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:13.197031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:13.197303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:13.197576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:13.198228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:13.199575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f44d-ff67-45cf-bf8b-0d829f52bce6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:13.206816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 459/912] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:13 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:13.782040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a3ab4-c6f7-4484-ba20-2ddad406278d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:13.783261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a3ab4-c6f7-4484-ba20-2ddad406278d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:13.783757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a3ab4-c6f7-4484-ba20-2ddad406278d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:13.785711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 454/913] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:13.790541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:13.790954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:13.791179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:13.810200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:13.811366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:13.883859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 460/914] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:13.906980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a3ab4-c6f7-4484-ba20-2ddad406278d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.021173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a3ab4-c6f7-4484-ba20-2ddad406278d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.058071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.058968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.059396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.059850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.060650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.062151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-83967da7-c321-4bae-89c8-f6c75cd591e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:14.072078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:14.073323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 19:52:14.074299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:14.076637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 455/915] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:14.085215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.087637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.194765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720daa88-3cee-46c0-ac7b-309a51da5e8b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.223980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe7da-9446-4db7-81d0-ab1c885e1873 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.224287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe7da-9446-4db7-81d0-ab1c885e1873 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.224533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe7da-9446-4db7-81d0-ab1c885e1873 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.226101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 456/916] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:14.231092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.231369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.231635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.232272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.232978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.233310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.233580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.234474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:14.234875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.236238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.241762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 461/917] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:14.247480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.250250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:14.251479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:14.308552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.320555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.335886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 457/918] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:14.357034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.372081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534500d-d82d-4b84-a421-259488f47d5e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.430728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.431756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.432130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.432471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.433488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:14.433881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.436123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.444787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 462/919] 10.222.0.95 () {56 vars in 1114 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:14.453489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.484177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296311f-e42e-4fb8-85ff-a4584b2afa95 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.520944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.521683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.521961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.522226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.534649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:14.540112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:14.541068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:14.541891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 458/920] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:14.550402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.588771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13be2-9ff0-4518-8ff4-514d4f019e9c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.600225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.628079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.639629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.640609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.641526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.641901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.642776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.645109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8822-711e-4199-a4e6-e98ed9d9cd93 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.669100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcfc2-ece6-4304-a382-3786ff88bf03 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.679870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 463/921] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:14.694067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044b7e1-30c7-410f-952e-987c90e40aa1 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.694341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044b7e1-30c7-410f-952e-987c90e40aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.694613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044b7e1-30c7-410f-952e-987c90e40aa1 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.696390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 464/922] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:14.702655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.704080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.704080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.730571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:14.731668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:14.743122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.744155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.744655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.745259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.746023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:14.746425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.747976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.758339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 459/923] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:14.764365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.823970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 465/924] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:14.841468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.880211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:14.883561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263011-4982-4ff7-8944-017e17fd81ac None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.922218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:14.922875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:14.923270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:14.923609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:14.935248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:14.936776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:14.955522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:14.956548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:14.957446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:14.957446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:14.957446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:14.957446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:14.959872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 460/925] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:14.971863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea6d16-bd90-49ed-bff7-c162c10e6da3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:14.972067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:14.985215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.012771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.013703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.014138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.014821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.016590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.017966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:15.032506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:15.033575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:15.034387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 466/926] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:15.042056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.111404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb2d6-e088-47aa-b59e-8d1d81767499 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.153752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce4d47-26af-400e-9dd9-15d4ef9709fa None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.160380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.161306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.162316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.162819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.163726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:15.164716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.166962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.186653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 461/927] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:15.188574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.192762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.194106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.194106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.194106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.194647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:15.194954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.196555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.206786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.206990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 467/928] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:15.208637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.262344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.317655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da995-301e-4fe2-8034-fc35b7ec657e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.332740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0806-87bb-4ea4-a561-504384560456 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.356854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.358287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.358805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.359352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.367570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.368980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.374094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.375313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.376605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.376605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.376824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:15.377160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.378557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-73728de7-af4b-43f2-9f4c-1e64c40b2e75 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:15.382550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:15.383464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:15.384440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:15.388051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 462/929] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:15.388341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 468/930] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:15.389228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416cba-551c-4684-bf97-08f6c0e13c11 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.389510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416cba-551c-4684-bf97-08f6c0e13c11 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.389782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416cba-551c-4684-bf97-08f6c0e13c11 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.389965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.391693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 463/931] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:15.392896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9416cba-551c-4684-bf97-08f6c0e13c11 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.484772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.514869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b488-8f45-4b8e-a088-7469fc13f73b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.518644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9416cba-551c-4684-bf97-08f6c0e13c11 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.525157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.553826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.554441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.554729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.555012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.555765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] RBAC: Adding query filter params (interface=public, service_id=5ac379d223004543a1fffdcbe21d5f71, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:15.556101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.556965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.557454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb8755-2fbc-4120-a5e3-c7a2f09ab370 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.557578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.557849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.558119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.558914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:15.559223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.560661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.563240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 469/932] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/endpoints?service_id=5ac379d223004543a1fffdcbe21d5f71&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:15.564341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.564626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.565585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.582619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 464/933] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:15.582990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:15.584087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.584211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:15.667451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 470/934] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:15.668699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.712759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a925b-68e6-4760-bef8-81a3bb890d8c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.743900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.753276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.753907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.754338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.754732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.755398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.757908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.775857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 465/935] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:15.775857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.791804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466760-4f79-455d-b6ab-af47f0e7856a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.793504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:15.833748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.834464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.834876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.835244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.849440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.851271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:15.869208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:15.870190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:15.871091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:15.871091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:15.871091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:15.871091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:15.871898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 471/936] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:15.877771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:15.920175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe33-b41c-4fb6-92de-1e44a594b1e7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:15.972521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:15.973179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:15.973635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:15.973908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:15.975106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:15.976558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:15.987729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:15.988914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 19:52:15.989853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:15.990722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 466/937] 10.222.0.95 () {56 vars in 1132 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:15.996880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.036353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975389f4-6e54-444c-98a0-9fbbee53f4ed None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.075173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.082617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.083507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.083930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.084205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.084962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:16.085264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.086682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.106564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 472/938] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:16.112769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.132005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd850b2-c6ac-4feb-890b-112ea760ea75 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.134171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.170040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.171093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.171598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.172076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.172930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:16.173454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.174996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.180585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 467/939] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:16.186334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.250219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a939-d89d-41ed-be58-dcf98e6ec653 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.298059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.298975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.299250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.299516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.307437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.308686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cde4-2b35-48aa-bc15-d62d6a4f2042 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.309039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:16.321396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:16.322335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:16.323202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 473/940] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:16.329847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.340253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.354913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.355765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.356225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.356636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.357615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:16.358069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.359896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.366238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 468/941] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:16.371432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.419910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.449405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cde90-abc7-47fa-9a88-9b0ecefe8c08 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.482832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ce702-43c9-4e14-8104-2fa8310e8074 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.487378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.488544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.489034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.489523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.490569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:16.491089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.492783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.511467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 474/942] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:16.512681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:16.520976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.521596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.521867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.522131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.522835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.524425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcec49a-08d1-43dc-a398-7c70ccd50458 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.552027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 469/943] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:16.638000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574ce6-db1e-4202-bb90-c6c86f4c0578 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:16.678287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:16.685183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:16.685906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.686176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.686443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/00947bb45d374dbba13ef2e02b9ce1f8/roles/04bef4b935114c4897b720fa84421f4d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.689570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=00947bb45d374dbba13ef2e02b9ce1f8, role_id=04bef4b935114c4897b720fa84421f4d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:16.691005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf0408-abf5-4bbe-8b29-334487497bcf None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:16.707268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 475/944] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:16 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/00947bb45d374dbba13ef2e02b9ce1f8/roles/04bef4b935114c4897b720fa84421f4d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:52:16.892450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1900df-437d-4e34-9f75-8c30af003f1b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.892951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1900df-437d-4e34-9f75-8c30af003f1b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.893311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1900df-437d-4e34-9f75-8c30af003f1b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.894887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 470/945] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:16.900336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:16.900795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:16.900869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:16.920759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:16.922292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:17.004000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 476/946] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:17.021491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1900df-437d-4e34-9f75-8c30af003f1b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:17.069409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:17.132231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1900df-437d-4e34-9f75-8c30af003f1b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:17.167500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:17.168153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:17.168427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:17.168696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:17.169434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:17.170897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:17.174272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING keystone.server.flask.common [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 19:52:17.193997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.sql.core [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 19:52:17.193997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 19:52:17.193997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [parameters: {'id': '61f881f72254403d9ee06cfd6ba67dd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 19:52:17.193997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61f881f72254403d9ee06cfd6ba67dd0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61f881f72254403d9ee06cfd6ba67dd0. Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:52:17.201368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 19:52:17.202145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application yield resource Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise self.value Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application session.commit() Aug 05 19:52:17.203826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.flush() Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application compat.raise_( Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 19:52:17.204722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 19:52:17.205616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:52:17.206477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [parameters: {'id': '61f881f72254403d9ee06cfd6ba67dd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:17.207440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:17.216880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 61f881f72254403d9ee06cfd6ba67dd0. Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:17.219335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 471/947] 10.222.0.95 () {60 vars in 1140 bytes} [Fri Aug 5 19:52:17 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:17.220671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:17.317970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad81dfc-8520-4e98-a899-b8b4e27cf600 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:17.341664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:17.362324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:17.362983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:17.363256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:17.363615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:17.371291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:17.372735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-238f1834-c00c-4fc5-a0cd-f1efff2ac5bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:17.385434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:17.387478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:17.389786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:17.393658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 477/948] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:17.393853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:17.495723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:17.500181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f4f68-3595-4ad5-8a52-dcafb3976ae5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:17.536247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:17.536920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:17.537197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:17.537465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:17.538184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:17.538482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:17.540114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2055-13d1-40c8-89fb-e7710ca83c1c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:17.567945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 472/949] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:17.938511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af562b33-6962-4a7f-b1b2-02e2377a12e2 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:17.939875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af562b33-6962-4a7f-b1b2-02e2377a12e2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:17.940428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af562b33-6962-4a7f-b1b2-02e2377a12e2 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:17.943123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 478/950] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:17.948358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:17.948643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:17.948918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:17.967995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:17.970169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:18.042087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 473/951] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:18.070089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af562b33-6962-4a7f-b1b2-02e2377a12e2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:18.178462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af562b33-6962-4a7f-b1b2-02e2377a12e2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:18.215735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:18.216395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.216672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.217001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.217631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:18.219028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:18.228409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:18.229391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:18.230227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 479/952] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:18.236023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:18.327892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:18.347771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9527-98e4-4856-8843-725936c08b3a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:18.387878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:18.388956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.389546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.390216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.391122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:18.391791 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:18.393521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:18.400074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 474/953] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:18.406263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:18.467361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:18.525729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554c6c7-393c-4584-ba9d-d981e133aea8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:18.561708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:18.562359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.562633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.562905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.563617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:18.563964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:18.565312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d5bd6-a509-4424-b077-d0e5b7b6dc67 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:18.570796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 480/954] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:18.576253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:18.683543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071a413-1170-4b99-9103-c9ff0340fd45 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:18.720527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:18.721065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.721399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.721673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.722505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:18.723902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e27f13-476b-4ca0-ae46-c4dbbe23e580 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:18.747837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 475/955] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:18.771231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a740eb-47a6-4e6a-ae03-376f32daf5f4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.771573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a740eb-47a6-4e6a-ae03-376f32daf5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.771823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a740eb-47a6-4e6a-ae03-376f32daf5f4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.773525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 481/956] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:18.779749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf921a8-2dd4-43e6-be22-d9b5c985678e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:18.780082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf921a8-2dd4-43e6-be22-d9b5c985678e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:18.780317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf921a8-2dd4-43e6-be22-d9b5c985678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:18.800894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ccf921a8-2dd4-43e6-be22-d9b5c985678e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:18.802189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ccf921a8-2dd4-43e6-be22-d9b5c985678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:18.804658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:18.890621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 476/957] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:18.913714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a740eb-47a6-4e6a-ae03-376f32daf5f4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.019346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4c8dc-d0a9-4808-8517-f417741570f2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.019566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4c8dc-d0a9-4808-8517-f417741570f2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.019898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4c8dc-d0a9-4808-8517-f417741570f2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.021506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 477/958] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:19.026428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.026712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.026998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.030999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a740eb-47a6-4e6a-ae03-376f32daf5f4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.047160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:19.048739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:19.056160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:19.067281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.067952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.068229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.068501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.069124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.070470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:19.079855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:19.081320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:19.082721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 482/959] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:19.087639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.129090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 478/960] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:19.156549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.205767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10daab7e-fcb8-4ca9-bc40-768daa649524 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.224147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:19.245337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.246381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.246890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.247415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.248306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:19.248806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.250791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.260929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 483/961] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:19.262407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.272040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a880b-c43a-4350-9afb-d04d255a0d93 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.300124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:19.314022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.314758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.314970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.315219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.330044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:19.335099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:19.336097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:19.336928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:19.341334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 479/962] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:19.343100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.392528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feeacc-9ba3-49b4-8c70-ac60f39db7a9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.448435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.449625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.450001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.450372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.451156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:19.451559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.453936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.463826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 484/963] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:19.474893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695b63b-fc2b-41c3-a6c1-1d012ad9c903 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.506330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:19.520358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.521469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.522004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.522629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.523599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:19.524150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.525822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.536846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 480/964] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:19.545129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.664949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:19.668113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e50f3-f74f-4000-93e8-e56298ef4c4a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.705166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.705808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.706084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.706352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.717281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.719420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:19.735088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:19.736061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:19.737184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:19.737184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:19.737184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:19.737184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:19.737184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 485/965] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:19.743680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.852320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54e22-1e45-46a4-9458-9a19c4586364 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:19.895931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:19.896568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.896845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.897115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.897814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:19.898115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:19.899464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785c403-8ba9-4c25-8f48-8e1027eff741 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:19.915058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 481/966] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:19.920736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:19.992352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2369c0-3d69-4313-91bd-7dcf18ba7097 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:19.992703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2369c0-3d69-4313-91bd-7dcf18ba7097 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:19.992896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2369c0-3d69-4313-91bd-7dcf18ba7097 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:19.994798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 482/967] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:19.999991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.000285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.000534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.019374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:20.020603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:20.034825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fd16b-a532-49b5-931f-cdbe4b1a3b62 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.075690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.076241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.076664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.076954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.077681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.090484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.092782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.106701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 483/968] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:20.109257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:20.110166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 19:52:20.111081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.117970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 486/969] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:52:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:20.119486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.133774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.152695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.236166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334042-d07e-4dd3-99db-2469d4f70025 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.261975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc3b5-6e96-483e-a48e-bc3598fe2061 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.276197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.276837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.277225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.277728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.278532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:20.278856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.280456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.305015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.305220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 484/970] 10.222.0.95 () {56 vars in 1149 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:20.305303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.305303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.305303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.306168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.307462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.308737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.312244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING keystone.server.flask.common [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 19:52:20.326851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.sql.core [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 19:52:20.326851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 19:52:20.326851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [parameters: {'user_id': 'f8a2bf2318d4416b9c6ce9b7712d6be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 19:52:20.326851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80519) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Aug 05 19:52:20.345485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:52:20.346441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application yield resource Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise self.value Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application session.commit() Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 19:52:20.347366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.flush() Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application compat.raise_( Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 19:52:20.348299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 19:52:20.349172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 19:52:20.351586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f8a2bf2318d4416b9c6ce9b7712d6be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:20.353626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 19:52:20.355460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 19:52:20.357652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.358480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.361047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 487/971] 10.222.0.95 () {60 vars in 1131 bytes} [Fri Aug 5 19:52:20 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:20.371946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.430641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f20e0c-6235-4960-a0cd-485af025e0aa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.470425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.471092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.471371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.471641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.520269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.545186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f5d8-c508-4125-a88b-e9ca37670fd7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.561219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.563585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.600314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.600956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.601228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.601490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.610789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.612718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.614402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:20.629154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:20.630167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 19:52:20.631139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:20.635115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 488/972] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:20.636002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.708596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 485/973] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:20.718929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:20.759933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678083b-6dae-4ee8-bc65-6830ee66cf3a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.801402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.802002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.802275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.802539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.803408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:20.803714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.805165 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.806921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.829535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177036a-52a8-46cf-97e9-300697a42d7f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:20.849214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 489/974] 10.222.0.95 () {56 vars in 1101 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:20.866542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:20.867114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:20.867390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:20.867661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:20.869996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:20.880403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:20.881886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0735f4a2-5869-489a-9e6d-e4fc6a6f30e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:20.898433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:20.899569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:20.900847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:20.900847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:20.900847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:20.900847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:20.900847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 486/975] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:20.907452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.017258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b221e-d1b9-4c18-8dce-c781c8470243 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.017479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b221e-d1b9-4c18-8dce-c781c8470243 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.017721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b221e-d1b9-4c18-8dce-c781c8470243 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.019076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 487/976] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:21.024326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.024718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.025088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.025324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827954-e326-456c-bbb6-0896ad976c61 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.052452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:21.054111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:21.067356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.068116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.068401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.071804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.071804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.071804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.072118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.089007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 490/977] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:21.095402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.152863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 488/978] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:21.164619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:21.177081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.218745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ea8c-06be-4ef1-a2d0-941455c9879f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.255739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.256772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.257228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.257743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.265626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.267527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.275847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10954f4-419c-44e6-9b37-5ed223b79a66 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:21.281345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:21.282339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:21.283427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:21.285370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 491/979] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:21.294028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.300054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:21.322338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.322987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.323261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.323529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.324179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.325532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:21.334697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:21.339973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:21.341066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 489/980] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:21.343555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.426891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f64e8-f406-4f4b-acc0-07e546df429d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.449003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:21.459110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822f52-0441-4e24-a95c-7d0ccd43af4f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.473546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.474169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.474449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.474728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.475486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.475808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.477262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.495590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 492/981] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:21.496518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.496665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.497148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.497442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.497689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.498367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.498673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.500075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.505854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 490/982] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:21.511200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.565355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:21.622418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430c59-8647-48b5-8e5a-297d81a470c1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.625900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2709d-d5e6-4b9f-a268-119012a4a2bf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.663945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.664558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.664831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.665103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.665882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] RBAC: Adding query filter params (role.id=04bef4b935114c4897b720fa84421f4d, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=00947bb45d374dbba13ef2e02b9ce1f8) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.666183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.667004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.667599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.667696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.667919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.668194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.668867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.669172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.670516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd3662-0d1a-45b7-b045-bfb96137efa3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.674020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 493/983] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/role_assignments?user.id=00947bb45d374dbba13ef2e02b9ce1f8&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=04bef4b935114c4897b720fa84421f4d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:21.687834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 491/984] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:21.694710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.744125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:21.754185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b18f7-a551-4bdc-98b5-38c77649cd2c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.754467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b18f7-a551-4bdc-98b5-38c77649cd2c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.754736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b18f7-a551-4bdc-98b5-38c77649cd2c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.756184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 492/985] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:21.761880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.762181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.762431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.783988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:21.785217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:21.834495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91588-c98f-4fb0-a363-45dbce885754 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:21.869304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 493/986] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:21.875129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:21.875757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:21.876174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:21.876358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:21.877127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] RBAC: Adding query filter params (interface=admin, service_id=5ac379d223004543a1fffdcbe21d5f71, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:21.877424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:21.878765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:21.884599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 494/987] 10.222.0.95 () {56 vars in 1249 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/endpoints?service_id=5ac379d223004543a1fffdcbe21d5f71&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:21.890591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.893564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:21.964475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:22.013323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:22.017717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c654-2991-438b-a498-92bfdbf618f5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:22.037645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391d2ec-e3c9-487f-b21d-4d62369cda15 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:22.063186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:22.063895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:22.064177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:22.064442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:22.065134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:22.066709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef63664-645c-476f-9a92-fa76194fd1e6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:22.081297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:22.081929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:22.082205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:22.082472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:22.083131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:22.091968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 495/988] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:21 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:22.093026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a149-c83c-4d86-beec-11171582576c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:22.093026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 494/989] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:21 2022] GET /identity/v3/services => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:23.933798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ce57-174b-4ee2-ab9c-edb3939188ad None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:23.934320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ce57-174b-4ee2-ab9c-edb3939188ad None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:23.934320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ce57-174b-4ee2-ab9c-edb3939188ad None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:23.936140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 496/990] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:23.941510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368a70-3e8b-49ef-b505-695458301bb9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:23.942080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368a70-3e8b-49ef-b505-695458301bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:23.942162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368a70-3e8b-49ef-b505-695458301bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:23.960904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a368a70-3e8b-49ef-b505-695458301bb9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:23.962144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a368a70-3e8b-49ef-b505-695458301bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:24.049497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 495/991] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:24.074858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9ce57-174b-4ee2-ab9c-edb3939188ad None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.137765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73b1b-912a-41ab-ad39-6e3f393314c7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.138114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73b1b-912a-41ab-ad39-6e3f393314c7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.138310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c73b1b-912a-41ab-ad39-6e3f393314c7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.140042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 496/992] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:24.145669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b647c2-c2c4-49ee-94f7-15f58edf688d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.145971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b647c2-c2c4-49ee-94f7-15f58edf688d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.146234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b647c2-c2c4-49ee-94f7-15f58edf688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.165137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-83b647c2-c2c4-49ee-94f7-15f58edf688d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:24.166323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83b647c2-c2c4-49ee-94f7-15f58edf688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:24.191467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.197280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9ce57-174b-4ee2-ab9c-edb3939188ad None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.229805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.230431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.230705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.230977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.231592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.233608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.236509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 497/993] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:24.244811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34836ef-12ce-49a0-ba26-863310608e4d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.244811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34836ef-12ce-49a0-ba26-863310608e4d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.244811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34836ef-12ce-49a0-ba26-863310608e4d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8466deea-be20-4c74-bb7d-1f0e32d1f4e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:24.245121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:24.246231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:24.247355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.248293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 498/994] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:24.248417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 497/995] 10.222.0.95 () {56 vars in 1105 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:24.251017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34836ef-12ce-49a0-ba26-863310608e4d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.252138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.252417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.252688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.270661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:24.272203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:24.290225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.341898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 498/996] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:24.343399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.368073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34836ef-12ce-49a0-ba26-863310608e4d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.403603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.404252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.404530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.404801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.405522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:24.405821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.407191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.419434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 499/997] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:24.419434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.442787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.456958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d950a4-e5a1-4d17-8d22-05f1ea7f2de2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.492194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.492839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.493119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.493389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.494012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.495383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:24.504896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:24.506027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:24.506872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 499/998] 10.222.0.95 () {56 vars in 1126 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:24.507652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.525243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.526181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61552adb-a50e-41fe-9ef9-553123561b4a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.562340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.562978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.563253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.563520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.564182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.565526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:24.574216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:24.575431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:24.576313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 500/999] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:24.577276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.625813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1780-dc6c-4bc3-956e-dc2251c79038 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.660403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.661021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.661298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.661567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.662242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:24.662544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.663918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.668515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 500/1000] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:24.669282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.681890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.697977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036acd-f0af-481c-9cad-c4b50a39a44c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.740885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.741526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.741807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.742077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.742773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:24.743080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.744641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.750281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 501/1001] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:24.755992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.770485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.794554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615443bd-d090-456f-bde1-b53e05e2c3d9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.838916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.839538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.839839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.840109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.841242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:24.841545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.843846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.850172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 501/1002] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:24.856133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.869874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ea5f-19a5-408e-a25f-a4add87a4ea7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:24.908169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:24.908788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:24.909086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:24.909474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:24.910505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:24.910811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:24.912218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:24.917190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 502/1003] 10.222.0.95 () {56 vars in 1122 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:24.923347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:24.941483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:24.963546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39540cf-f2b5-4780-9d1f-716f8267334d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:25.006508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:25.008085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:25.008365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:25.008636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:25.009453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:25.009757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:25.011110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:25.022493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 502/1004] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:25.024176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:25.038146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:25.050768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a4ad-8a15-4b7e-afc5-47f23c3b551d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:25.101599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:25.102402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:25.102810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:25.103209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:25.104323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:25.106388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:25.139815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 503/1005] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:25.147951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf9d3-42fa-49d6-b1a6-08588a795344 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:25.194704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:25.195340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:25.195615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:25.195914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:25.196688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] RBAC: Adding query filter params (interface=public, service_id=ce525f34bb8f407bb416b907019d6604, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:25.196995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:25.198406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329aa2a-6c34-4fe7-aa90-1334a07f6d30 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:25.204683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 503/1006] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:52:25 2022] GET /identity/v3/endpoints?service_id=ce525f34bb8f407bb416b907019d6604&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:25.215972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:25.341907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:25.370209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8570-3208-41c4-94a2-b8588e32ce16 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:25.406499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:25.407248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:25.407592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:25.407989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:25.408656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:25.410301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2779715-c457-4c05-a0e9-32b62dae5c11 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:25.419156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 504/1007] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:25 2022] GET /identity/v3/services => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:26.967401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf56-6ed7-40e0-87b5-e6ce77caf4ed None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:26.967984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf56-6ed7-40e0-87b5-e6ce77caf4ed None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:26.967984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf56-6ed7-40e0-87b5-e6ce77caf4ed None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:26.969504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 504/1008] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:26.974493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980abd2-d337-4cda-89ee-80f496652ca3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:26.975229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980abd2-d337-4cda-89ee-80f496652ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:26.975229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980abd2-d337-4cda-89ee-80f496652ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:26.994231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c980abd2-d337-4cda-89ee-80f496652ca3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:26.995411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c980abd2-d337-4cda-89ee-80f496652ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:27.067911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 505/1009] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:27.090484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebf56-6ed7-40e0-87b5-e6ce77caf4ed None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:27.166779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:27.202860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebf56-6ed7-40e0-87b5-e6ce77caf4ed None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:27.242006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:27.242537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.242808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.243077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.243757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:27.245144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6563fa-dcfe-4fc2-a437-35d38259ba4f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:27.263125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 505/1010] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:27 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:27.264278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010fdf-fe23-4c22-b3aa-b3502ea00576 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.264797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010fdf-fe23-4c22-b3aa-b3502ea00576 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.265271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010fdf-fe23-4c22-b3aa-b3502ea00576 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.266286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 506/1011] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:27.273801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.274248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.274602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.297508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:27.298779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:27.402326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 506/1012] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:27.428492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010fdf-fe23-4c22-b3aa-b3502ea00576 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:27.508633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:27.547450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010fdf-fe23-4c22-b3aa-b3502ea00576 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:27.584764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:27.585407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.585685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.585952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.587177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:27.588676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235733e-5f84-48a2-b53c-4abeef784d0f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:27.595913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 507/1013] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:27.598109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:27.659150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:27.708198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8b2e-d185-4749-a099-b48ce7aefb45 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:27.744131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:27.744757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.745034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.745305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.745998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:27.746963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5daf-d514-47b8-918a-68973c7fda70 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.747413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:27.747511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5daf-d514-47b8-918a-68973c7fda70 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.748083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5daf-d514-47b8-918a-68973c7fda70 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.750396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 508/1014] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:27.756318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:27.756709 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:27.757086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:27.780001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 507/1015] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:27 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:27.784046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:27.786071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:27.891810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 509/1016] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:27.913052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:28.052354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efb74-e6e4-4440-800a-efded3e1dce7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:28.062498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:28.090112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:28.090754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:28.091027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:28.091293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:28.092121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:28.093621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:28.103956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:28.104993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:28.105837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 508/1017] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:28.113295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:28.196653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:28.249769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fa06d-1f3e-47be-8e7a-fb522b65d5c8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:28.297074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:28.298000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:28.298445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:28.298896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:28.300065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:28.300549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:28.302733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:28.315016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 510/1018] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:28.316865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:28.436853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7a206-0703-4159-9525-1490649efec3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:28.473189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969893-912e-40de-83ab-f36567cb307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:28.473817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969893-912e-40de-83ab-f36567cb307b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:28.474093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969893-912e-40de-83ab-f36567cb307b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:28.474365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969893-912e-40de-83ab-f36567cb307b None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:28.475044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969893-912e-40de-83ab-f36567cb307b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:28.475342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969893-912e-40de-83ab-f36567cb307b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:28.476732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969893-912e-40de-83ab-f36567cb307b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:28.487226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 509/1019] 10.222.0.95 () {56 vars in 1112 bytes} [Fri Aug 5 19:52:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:28.493223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:28.611551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455aec-cf3a-4be3-8b31-c533c60a4409 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:28.641293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:28.648708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:28.649328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:28.649603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:28.649872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:28.650579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:28.652222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da922-bb1f-43ce-941c-c6444f0a70fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:28.679871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 511/1020] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:29.506589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31afdf-0170-4ddb-b3f4-eac16f92233b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:29.507138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31afdf-0170-4ddb-b3f4-eac16f92233b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:29.507138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31afdf-0170-4ddb-b3f4-eac16f92233b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:29.511829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 510/1021] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:29.514058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:29.514967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:29.515287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:29.534339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:29.535525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:29.616797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 512/1022] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:29.643710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31afdf-0170-4ddb-b3f4-eac16f92233b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:29.687226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:29.772183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31afdf-0170-4ddb-b3f4-eac16f92233b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:29.809504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:29.810192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:29.811071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:29.811534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:29.812389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:29.813763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d468002e-3648-49af-87c9-4bab706328e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:29.823098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:29.824131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:29.824962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 511/1023] 10.222.0.95 () {56 vars in 1105 bytes} [Fri Aug 5 19:52:29 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:29.833932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:29.912336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0237-aa9f-4dfe-9159-0d52c2ecf15c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:29.912697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0237-aa9f-4dfe-9159-0d52c2ecf15c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:29.912921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0237-aa9f-4dfe-9159-0d52c2ecf15c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:29.914620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 512/1024] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:29.920517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:29.920893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:29.921260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:29.941434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:29.942540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:29.954777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ff8af-d969-4230-a1d2-e14da7dea79b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:29.973293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:30.000767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.004302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.005854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.006443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.007434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:30.007907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.009401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.015403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 513/1025] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:30.019819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 513/1026] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:30.021541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:30.041851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:30.084788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:30.148763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c6923-159c-44b2-82e0-dc185a18d65f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:30.184067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbd411-6bc6-4b33-a932-e016330e4b90 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:30.197418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.197973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.198259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.198527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.199205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] RBAC: Adding query filter params (type=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:30.199509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.200982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.206556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 514/1027] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:30.212497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:30.227006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.227658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.227966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.228235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.229474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.230901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.233369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 514/1028] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:30.239460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:30.264156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:30.354599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb806b-04d3-4a64-9ba2-8be25dde4171 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:30.364575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:30.369277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f41b3-a0a1-4cca-88a7-74e1c25a58c1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:30.403399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.405213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.405476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.406629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.407675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] RBAC: Adding query filter params (interface=public, service_id=84a34a07185d4b84b8d6ab26eb693450, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:30.409118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.410644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.423888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 515/1029] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:52:30 2022] GET /identity/v3/endpoints?service_id=84a34a07185d4b84b8d6ab26eb693450&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:30.426094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:30.427310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.428817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.429246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.429663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.430944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.436853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353adb34-ef46-44f8-8665-77359b912e4a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.481484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 515/1030] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:52:30 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:30.596149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8761-d0a6-4b71-bf01-5e1dc1963dd6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:30.598850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:30.635586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:30.636900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.637145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.637528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.638080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:30.640057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070b7ec-4bef-4f08-9fc4-5755b18f1e9a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:30.646894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 516/1031] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:52:30 2022] GET /identity/v3/services => generated 1957 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:52:30.916820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ec3f-7c8d-415e-9a76-e9f391134e67 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.917322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ec3f-7c8d-415e-9a76-e9f391134e67 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.917400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ec3f-7c8d-415e-9a76-e9f391134e67 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.918853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 516/1032] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:30.924697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:30.924980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:30.925701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:30.945288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:30.946465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:31.020692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 517/1033] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:31.044361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9ec3f-7c8d-415e-9a76-e9f391134e67 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.157562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9ec3f-7c8d-415e-9a76-e9f391134e67 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:31.194009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:31.194568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:31.194843 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:31.195157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:31.207198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:31.212234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:31.213179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:31.214029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 517/1034] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:31.219934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.323572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:31.329464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95acd-3d0a-4287-8c9b-c1ad8881ac9d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:31.366093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:31.366723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:31.366996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:31.367260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:31.368096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:31.368400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:31.369754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:31.378651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 518/1035] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:31.384173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.402342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:31.511033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0aa2-6efe-4273-bf22-37a0aec74296 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:31.550018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:31.551602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:31.552454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:31.553237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:31.571039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:31.574666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:31.594663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:31.595771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:31.596889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:31.596889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:31.596889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:31.596889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:31.599930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 518/1036] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:31.605420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.708903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2179a5-2bf6-449d-97f4-0f57f82cea1e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:31.744877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:31.745496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:31.745769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:31.746035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:31.746729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:31.747067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:31.748475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:31.760706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 519/1037] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:31.766205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.838459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:31.879216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb785b-de59-4b99-bce9-d9e0fa105215 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:31.930133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:31.931943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:31.932222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:31.932494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:31.943877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:31.948536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:31.961694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:31.962772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:31.963720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:31.968137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 519/1038] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:31.969993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:31.994845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.084658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc06a-6a6a-40dd-a3d0-97d93d0cceaf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:32.121763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:32.122423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.122702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.123060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.124074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:32.124374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:32.125778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:32.147810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 520/1039] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:52:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:32.151320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:32.262815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4b49-5d52-49c7-b437-e3a8273b1f7a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:32.292525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.303102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:32.303829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.304095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.304363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.380337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:32.381695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:32.499326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 520/1040] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:32.500640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:32.581362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.608120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d61f-5cd4-4880-9233-45ef2add1df9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:32.646681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:32.647676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.648150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.648561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.660507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:32.662191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6ad0cfed-f634-4a4a-985d-8b61c63a4259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:32.679456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:32.680917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:32.687315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:32.687315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:32.687315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:32.687315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:32.687315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 521/1041] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:32.688754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:32.717989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.722504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bf64-9821-46ad-b4f4-1e623132ffcb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.723118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bf64-9821-46ad-b4f4-1e623132ffcb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.723399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bf64-9821-46ad-b4f4-1e623132ffcb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.725076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 522/1042] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:32.731285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0dc2-9411-4d22-91a7-0a7f4404b627 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.731547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0dc2-9411-4d22-91a7-0a7f4404b627 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.731898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f0dc2-9411-4d22-91a7-0a7f4404b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.750426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7f5f0dc2-9411-4d22-91a7-0a7f4404b627 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:32.751604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7f5f0dc2-9411-4d22-91a7-0a7f4404b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:32.795206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ce73-2de7-4634-9dc2-3f65623c9c76 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:32.829551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:32.829773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 523/1043] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:32.830960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826789a-44af-4ef2-a39f-a28d6085ce16 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.831241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826789a-44af-4ef2-a39f-a28d6085ce16 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.831510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826789a-44af-4ef2-a39f-a28d6085ce16 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.832317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.832604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.832801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 524/1044] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:32.832918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.833567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:32.833869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:32.835237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:32.841104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:32.841564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:32.841834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:32.847549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 521/1045] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:32.852880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:32.861610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:32.862530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:32.921130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.933743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 525/1046] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:32.934569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:32.944486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:32.961381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d19d63-4401-4344-9610-7b8f7e6ff961 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:32.999413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.000190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.000493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.000765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.007436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.008905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:33.020623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:33.021849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 522/1047] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:33.023048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.043094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77d85-210c-4241-ba3e-508c5e23a3ca None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.077373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.078006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.078281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.078552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.088733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:33.094273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:33.095247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 526/1048] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:33.096380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.128723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b59496-0e95-47e8-8926-979da2742ea3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.148368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.163500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.164162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.164452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.164703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] PATH_INFO: `/v3/services/image` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.165320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.166681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:33.176042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:33.177123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:33.177950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 523/1049] 10.222.0.95 () {56 vars in 1105 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:33.178723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.194217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.205977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b172-e790-43f5-b17a-da5ac6f15cd0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.240186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.240793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.241066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.241336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.242078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:33.242380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.243810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.255620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 527/1050] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.256442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.287048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1a44e-4332-49a6-ba9d-8b7d75972c1a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.321892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.322499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.322772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.323036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.323740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:33.324066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.325502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.337955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 524/1051] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.338795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.364252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4864f-a5b1-4fce-a537-495b37bd6792 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.375662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.401205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.401883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.402158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.402426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.403105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:33.403934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.405294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.410273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 528/1052] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.411034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.421411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.453121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334887f-33f1-4f96-bebd-ac12d0ed1eeb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.487495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.488144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.488420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.488689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.489478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] RBAC: Adding query filter params (role.id=04bef4b935114c4897b720fa84421f4d, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:33.489781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.491193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.496782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 525/1053] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=04bef4b935114c4897b720fa84421f4d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.497471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.537017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c9c-90c6-4bc8-8e54-c56d2855509d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.586298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.587789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.588085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.588356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] PATH_INFO: `/v3/users/33dcd89081424d70b1b8f3a77ad4b040` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.604959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] RBAC: Authorizing `identity:get_user(user_id=33dcd89081424d70b1b8f3a77ad4b040)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.606404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.608407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 529/1054] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/users/33dcd89081424d70b1b8f3a77ad4b040 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.614262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.626173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382d7f-79e6-4c0b-afe0-42ea3991e8ba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.649984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.667101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.667730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.668034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.668313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.669652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] RBAC: Adding query filter params (type=image) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:33.669652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.670865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.673349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:33.678355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 526/1055] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:33.683401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:33.730775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c57a6-9e3d-4b56-9306-6612fc124d05 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.771476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.772131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.772409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.772680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.802479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb743f-ee3a-4443-866c-f749a107cd08 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:33.838558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:33.839246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:33.839520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:33.839863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:33.840573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.842218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.859739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:33.861212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:33.863828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 527/1056] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:52:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:52:33.901965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:34.000820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 530/1057] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:34.006743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:34.070786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:34.130555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9dc81-627a-4785-8a6d-bc37d32dca74 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:34.166371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:34.167004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:34.167279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:34.167545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:34.168704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:34.170804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f8c8-b487-4bb3-868d-164e9ad7b3ce None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:34.172806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 528/1058] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:34 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:34.178999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:34.294559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47357-9d67-418f-a8ae-8744d3ab64b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:34.325071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:34.331922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:34.332540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:34.332811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:34.333078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:34.333916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=9943f4a6af5744f2bb8edf5f70526173, user.id=33dcd89081424d70b1b8f3a77ad4b040) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:34.334224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:34.335632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95df954-c7b6-4c45-b534-7ab2b8fa0fca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:34.341337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 531/1059] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:34 2022] GET /identity/v3/role_assignments?user.id=33dcd89081424d70b1b8f3a77ad4b040&scope.project.id=9943f4a6af5744f2bb8edf5f70526173&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:35.613163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63ea5f-9d14-4f76-a4e5-1684799b5279 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:35.613733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63ea5f-9d14-4f76-a4e5-1684799b5279 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:35.613733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63ea5f-9d14-4f76-a4e5-1684799b5279 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:35.615063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 529/1060] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:35.620711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:35.621197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:35.621295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:35.644628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:35.645825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:35.728199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 532/1061] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:35.751591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63ea5f-9d14-4f76-a4e5-1684799b5279 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:35.860199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63ea5f-9d14-4f76-a4e5-1684799b5279 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:35.881405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:35.897310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:35.897950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:35.898219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:35.898482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:35.910335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:35.915231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:35.916397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:35.917610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 530/1062] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:35.922427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.023848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da857f-ec39-4563-a821-f18c4a8c640d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.050718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.060471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.061285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.061561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.061829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.062544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:36.062842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.064210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2555ab-b236-4770-8a73-de41262b5cc8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.072501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 533/1063] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:36.082115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.224601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349396c-2150-4717-8966-730d3ab313a1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.233039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268f36c-f434-449e-bfa5-7d6719e4d293 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.234084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268f36c-f434-449e-bfa5-7d6719e4d293 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.234084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268f36c-f434-449e-bfa5-7d6719e4d293 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.235418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 534/1064] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:36.240880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.241160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.241436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.260508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:36.261812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:36.275369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.276806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.277378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.277804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.289852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.291539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:36.308672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:36.315747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 531/1065] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:36.316808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.345435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 535/1066] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:36.350059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.368382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.436172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a780c00-8343-4f5b-8914-8cf639e706de None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.480148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.480779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.481054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.481488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.482195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:36.482489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.483866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.485568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbb279-1de7-4dcb-9bfa-0ececc931d39 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.495617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 532/1067] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:36.501349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.509470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.530333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.530863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.531138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.531406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.599790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.600320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.601287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf6f9-a94b-42bd-92da-bf9c63fb7113 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.610615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad86f3-6f22-42d2-a626-dc71047ad35d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.649683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.650358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.650824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.651091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.660147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.662615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-232083ca-92b5-455b-8a7c-3efed295dd45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:36.675748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:36.677790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:36.679439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 533/1068] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:36.680507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dfe6-4d04-4be6-8617-e0e13459385f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.680507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dfe6-4d04-4be6-8617-e0e13459385f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.680507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dfe6-4d04-4be6-8617-e0e13459385f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.682276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 534/1069] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:36.683409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3dfe6-4d04-4be6-8617-e0e13459385f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.709562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 536/1070] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:36.710918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.711209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.711482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.735268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:36.736487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:36.751227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.800107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3dfe6-4d04-4be6-8617-e0e13459385f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.820005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 537/1071] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:36.820005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.838905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.839518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.839806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.840080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.841474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:36.841774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.843291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.865001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 535/1072] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:36.869907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.880286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.926039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0727-1505-4b7d-9c36-392ab6476de0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:36.960854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:36.961491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:36.961763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:36.962034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:36.972719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:36.974160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:36.983469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:36.990383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:36.991466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:36.992478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:36.992478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:36.992478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:36.992478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:36.996171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 538/1073] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:36.997712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:36.998764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8589-af73-4a71-8bed-a92bde81b551 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.045790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.046440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.046714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.046980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.057905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:37.063534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:37.064706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 536/1074] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:37.065596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.128338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259e06-34fa-420b-a1b3-f4c9ff5cb74e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.144198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.164389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.165032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.165310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.165581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.177657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.177844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2a7f-6da9-491d-8537-8f12d76a1a41 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.179096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:37.194584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:37.195579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 539/1075] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:37.196805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.220526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.221150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.221430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.221699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.222389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:37.222690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.224268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.236338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 537/1076] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:37.237176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.253901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.311421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e330bfa-8cdc-488a-aee9-892ca3012634 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.352678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.353674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.354183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.354898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.355845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:37.356237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.358035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.376086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 540/1077] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:37.378353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.386630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd192266-4435-4363-8d0b-df8d42a3556f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.428341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.436119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.436745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.437022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.437292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.437985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:37.438287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.440779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.454827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 538/1078] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:37.460545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.519951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677092-4bf8-4eaf-ad38-7e4edb6f97b7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.538317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.560405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.561051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.561322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.561640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] PATH_INFO: `/v3/users/33dcd89081424d70b1b8f3a77ad4b040` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.562779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] RBAC: Authorizing `identity:get_user(user_id=33dcd89081424d70b1b8f3a77ad4b040)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.564226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.565832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 541/1079] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/users/33dcd89081424d70b1b8f3a77ad4b040 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:37.571675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.584103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be67f-ae95-472a-b771-c302c8dd7f2c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.621756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.623301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.623301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.623301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.633964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.635398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:37.647091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:37.648178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:37.649432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 539/1080] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:37.654778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.684999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4893f5-6839-449c-aa53-cfd4a35cb790 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.705876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.719308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.720137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.720243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.720483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.721632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.723164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.724750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 542/1081] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:37.730578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.760759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1b3f-8b8e-4db4-a2f6-357fa304f983 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.781469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.796321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.796942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.797214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.797479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.798228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:37.798529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.800003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.812471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 540/1082] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:37.818622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:37.834208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab2e2c-681a-4a54-9650-72779037c496 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.871161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.872057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.872409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.872620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173/users/33dcd89081424d70b1b8f3a77ad4b040/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.874632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] RBAC: Authorizing `identity:create_grant(project_id=9943f4a6af5744f2bb8edf5f70526173, user_id=33dcd89081424d70b1b8f3a77ad4b040, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.876103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cadc91-0d41-4735-8b67-427637816898 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.889296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 543/1083] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:37 2022] PUT /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173/users/33dcd89081424d70b1b8f3a77ad4b040/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:52:37.924650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef85f-4cdb-49f8-be5c-3ba17807d6e7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:37.936952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:37.964635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:37.965331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:37.965690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:37.965981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/04bef4b935114c4897b720fa84421f4d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:37.968303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=b7f6f07c961a46329912067a520beae1, role_id=04bef4b935114c4897b720fa84421f4d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:37.969764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232687d4-6be3-4733-9ab6-4ad4cd0284e0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:37.985256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 541/1084] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:37 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b7f6f07c961a46329912067a520beae1/roles/04bef4b935114c4897b720fa84421f4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 19:52:39.951863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d98-3f77-4d56-bd72-1106d7786e6b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:39.952431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d98-3f77-4d56-bd72-1106d7786e6b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:39.952431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d98-3f77-4d56-bd72-1106d7786e6b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:39.953767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 544/1085] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:52:39.959228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:39.959670 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:39.959805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:39.979729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:39.982223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:40.048391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c123-83c0-4e73-be76-0631d9d3af65 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.048664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c123-83c0-4e73-be76-0631d9d3af65 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.049135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c123-83c0-4e73-be76-0631d9d3af65 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.050490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 545/1086] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:40.052836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 542/1087] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:40.055755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.056068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.056346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.074870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:40.076185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.076797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:40.150937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 546/1088] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:40.175480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.183317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.186649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f203-1780-4001-93f4-f2b3609aa7c5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.220384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.234236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.235255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.235592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.235900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.247580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:40.253256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:40.254375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:52:40.255204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:40.255881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 543/1089] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:40.263360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.281710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea3309-3573-455a-9af1-b4345287f002 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.319907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.320555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.320829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.321098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.332253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:52:40.337149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:40.338113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:40.338969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 547/1090] 10.222.0.95 () {56 vars in 1120 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:40.345068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.380637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782124e9-6432-4229-a278-3952190ebcaf None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.416744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.417375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.417653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.417921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.418677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:40.419159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.421056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.429838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 544/1091] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:40.436309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.451363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.454869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e02376-94ac-43b3-9b28-b50ed14926d4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.462637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.490131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.490671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.490948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.491217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.491971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:40.492275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.493621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.502327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 548/1092] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:40.507953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.546427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180c6d-54cc-4d98-be1e-c95aec150210 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.584882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.585522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.585799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.586071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] PATH_INFO: `/v3/users/33dcd89081424d70b1b8f3a77ad4b040` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.587241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] RBAC: Authorizing `identity:get_user(user_id=33dcd89081424d70b1b8f3a77ad4b040)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.588700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.591224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 545/1093] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/users/33dcd89081424d70b1b8f3a77ad4b040 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:40.597767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.616108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238043-6ffa-4aec-9f3d-64c98345fd57 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.659868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.660514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.660786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.661050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.672337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.673766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:40.687888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:40.688966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:40.690094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:40.690094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:40.690094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:40.690094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:40.690094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 549/1094] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:40.694830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.696942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.710468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.713026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3eb27-d48a-4b4a-94d2-054176a96d7e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.747772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.748383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.748681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.748958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.805946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0929-ddf9-476e-b3c2-0b962cc21fe2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:40.819531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.821000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.844567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:40.845525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:40.845931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:40.846425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:40.847547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:40.848081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:40.849832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:40.862325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 550/1095] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:40.867962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.913900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.925791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 546/1096] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 19:52:40.931588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:40.948461 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:40.977880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c480fb-d472-42ab-be02-29bb4cc2dc07 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.018801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.019361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.019637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.019947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.028075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.029579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.036029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491c06-b312-47b9-bb7b-cb5017f1cb09 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:52:41.044776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:41.045926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:52:41.046888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 551/1097] 10.222.0.95 () {56 vars in 1093 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:41.052019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:41.073099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.073775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.074092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.074958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.076208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.078110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.079795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 547/1098] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:40 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:41.085788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:41.155678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.169040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a445-328d-4380-aaa3-0cc31c96119c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.198485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ac02-b94b-4328-8a61-bbad0eab2cc7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.208826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.209442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.209718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.209980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.210769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:41.211068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.212553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.214233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.231757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 552/1099] 10.222.0.95 () {56 vars in 1133 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:41.237637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:41.239998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.240613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.240883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.241146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.241928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=9943f4a6af5744f2bb8edf5f70526173, user.id=33dcd89081424d70b1b8f3a77ad4b040) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:41.242230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.243626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.250300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 548/1100] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/role_assignments?user.id=33dcd89081424d70b1b8f3a77ad4b040&scope.project.id=9943f4a6af5744f2bb8edf5f70526173&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:41.346614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f986198-6379-4955-adf1-8cc298bb0f3d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.391314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.392140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.392287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.392512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.460208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.470341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.471830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.567891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 553/1101] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 19:52:41.573694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:41.675734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e602-f4f9-44e4-bcbf-dcd92b6c325d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.702763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.714615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.715301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.715571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.715872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.726433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.727876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:52:41.742995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:41.744070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:41.750666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:52:41.750666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:52:41.750666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:52:41.750666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:41.750666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 549/1102] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:52:41.751105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:41.853952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:41.867338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76625b-5232-415d-a973-b55687c24b65 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:41.907429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:41.908062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:41.908335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:41.908603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:41.909289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:41.909583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:41.910926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:41.928055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 554/1103] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:41.933653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:42.037001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e87c87-db54-45ae-876e-ee9a21b20891 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:42.078954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:42.079602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:42.079925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:42.080168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:42.088483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:42.091651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:52:42.103806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:52:42.104711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:52:42.105651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 550/1104] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:52:42.111995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:42.226986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1fc-a168-4338-b79a-7460525e2b4b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:42.270544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:42.271448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:42.271958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:42.272305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:42.273047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:42.273346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:42.274996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237ac0-ebac-438d-959d-dc7b6bf7d0e9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:42.287618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 555/1105] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:42.294150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:42.330792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:42.400724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf414c3-58dc-4a0a-b8c3-95d15a668f95 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:42.449375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:42.449995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:42.450679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:42.450955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:42.451758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] RBAC: Adding query filter params (role.id=04bef4b935114c4897b720fa84421f4d, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b7f6f07c961a46329912067a520beae1) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:42.452093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:42.453550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3759bfb-ba8e-495d-8cb2-d4d95c456b73 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:42.460106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 551/1106] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:42 2022] GET /identity/v3/role_assignments?user.id=b7f6f07c961a46329912067a520beae1&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=04bef4b935114c4897b720fa84421f4d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:43.637788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f510-0f24-4570-b06d-ae3b5a75d5c7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:43.638604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f510-0f24-4570-b06d-ae3b5a75d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:43.638769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f510-0f24-4570-b06d-ae3b5a75d5c7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:43.640272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 556/1107] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:43.645477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:43.645897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:43.646001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:43.666385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:43.667565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:43.752838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 552/1108] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:43.787175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f510-0f24-4570-b06d-ae3b5a75d5c7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:43.806577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:43.902884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f510-0f24-4570-b06d-ae3b5a75d5c7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:43.939092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:43.940342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:43.940342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:43.940342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:43.941664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:43.942814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74466a-fc20-4176-83e9-d600c8737c00 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:43.944423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 557/1109] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:43.950560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:43.977251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:44.054437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722f5e5-3a5a-4617-a041-95d94c693a16 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:44.088645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:44.089257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:44.089730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:44.090007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:44.090683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:44.092138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3fc29-7d64-4f08-8ad1-a85e6e34aed5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:44.114894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 553/1110] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:52:43 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:46.201760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7497c-57bc-4616-8e66-1930b838fa86 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:46.202344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7497c-57bc-4616-8e66-1930b838fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:46.202344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7497c-57bc-4616-8e66-1930b838fa86 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:46.203643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 558/1111] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:46.208995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:46.209411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:46.209584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:46.229671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:46.231216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:46.298390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 554/1112] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:46.321734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7497c-57bc-4616-8e66-1930b838fa86 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:46.405298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:46.425065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7497c-57bc-4616-8e66-1930b838fa86 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:46.458410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:46.458976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:46.459249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:46.459518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] PATH_INFO: `/v3/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:46.460979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] RBAC: Authorizing `identity:get_role(role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:46.462323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:46.463654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 559/1113] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:46 2022] GET /identity/v3/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:46.470787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:46.487469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:46.571216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342721d5-34aa-480c-beb7-7a5943c445e0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:46.603663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:46.604351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:46.604629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:46.604896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] PATH_INFO: `/v3/users/d590e56c4a204a2e81efda1a05d261ce` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:46.617507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] RBAC: Authorizing `identity:get_user(user_id=d590e56c4a204a2e81efda1a05d261ce)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:46.618911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:46.621101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 555/1114] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:46 2022] GET /identity/v3/users/d590e56c4a204a2e81efda1a05d261ce => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:52:46.627042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:46.724155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebfad-4081-4929-9991-b1d73aea7a7c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:46.756825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:46.757433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:46.757705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:46.757972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:46.781717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:46.835039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:46.836510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:46.934421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 560/1115] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:46.940367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:47.008140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:47.037599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11454f8d-9b27-4a99-8ea6-b0bc2c61621e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:47.070623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:47.071252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:47.071528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:47.071817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:47.072946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:47.074709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618aa8b-680b-425c-a05d-a98e4911082d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:47.076391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 556/1116] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:46 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:47.082579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:47.139126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:47.200373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb7f7-d9ae-482b-9bb7-cd9ef633ccd0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:47.233186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:47.233797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:47.234041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:47.234306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:47.235076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=9943f4a6af5744f2bb8edf5f70526173, user.id=d590e56c4a204a2e81efda1a05d261ce) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:47.235377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:47.236805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5b45-b373-4896-b9a7-4ed5d59f6079 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:47.241933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 561/1117] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:47 2022] GET /identity/v3/role_assignments?user.id=d590e56c4a204a2e81efda1a05d261ce&scope.project.id=9943f4a6af5744f2bb8edf5f70526173&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:49.243366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124b888-52e2-4614-ba28-2012cce4209e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.243928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124b888-52e2-4614-ba28-2012cce4209e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.243928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124b888-52e2-4614-ba28-2012cce4209e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.245437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 557/1118] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:49.250993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.251530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.251619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.271436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:49.272659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:49.338337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 562/1119] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:49.360829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124b888-52e2-4614-ba28-2012cce4209e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:49.462028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124b888-52e2-4614-ba28-2012cce4209e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:49.496882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:49.497440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.497716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.497985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] PATH_INFO: `/v3/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.499406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] RBAC: Authorizing `identity:get_role(role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:49.500933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:49.502283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 558/1120] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:49 2022] GET /identity/v3/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:49.508135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:49.551620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:49.607018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f989998-7b92-480c-9d9e-118c5b05ae0c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:49.640149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:49.640781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.641055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.641320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] PATH_INFO: `/v3/users/d590e56c4a204a2e81efda1a05d261ce` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.642480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] RBAC: Authorizing `identity:get_user(user_id=d590e56c4a204a2e81efda1a05d261ce)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:49.643908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:49.645502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 563/1121] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:49 2022] GET /identity/v3/users/d590e56c4a204a2e81efda1a05d261ce => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:49.651789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:49.663056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:49.753006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169ebbe-60c5-4e1a-b458-31f96129c911 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:49.787688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:49.788349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.788631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.788905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.790050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:49.791458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d3d07-a985-4a54-8b3f-a6a7881bd75f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:49.793823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 559/1122] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:49 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:49.799759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:49.895575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf866b-6df1-4783-97f4-8daffdb7c384 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:49.906398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:49.929887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:49.930540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:49.930813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:49.931083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173/users/d590e56c4a204a2e81efda1a05d261ce/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:49.933789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] RBAC: Authorizing `identity:create_grant(project_id=9943f4a6af5744f2bb8edf5f70526173, user_id=d590e56c4a204a2e81efda1a05d261ce, role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:49.935188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9923-d963-45b5-91f2-4336731c8073 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:49.947372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 564/1123] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:52:49 2022] PUT /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173/users/d590e56c4a204a2e81efda1a05d261ce/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:52:51.967273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac2c5-e28d-4dc2-b5b7-ab34d2b68428 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:51.967851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac2c5-e28d-4dc2-b5b7-ab34d2b68428 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:51.967851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac2c5-e28d-4dc2-b5b7-ab34d2b68428 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:51.969198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 560/1124] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:51.974404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:51.974806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:51.974952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:51.992965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:51.994150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:52.061106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 565/1125] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:52.085178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac2c5-e28d-4dc2-b5b7-ab34d2b68428 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:52.161322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:52.185641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac2c5-e28d-4dc2-b5b7-ab34d2b68428 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:52.219693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:52.220277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:52.220559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:52.220828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] PATH_INFO: `/v3/roles/0833044dd2f8488aab51a45b7ea352a8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:52.222246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] RBAC: Authorizing `identity:get_role(role_id=0833044dd2f8488aab51a45b7ea352a8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:52.223591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:52.224962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 561/1126] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:52 2022] GET /identity/v3/roles/0833044dd2f8488aab51a45b7ea352a8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:52.231072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:52.329547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:52.332952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465491db-14c8-46d0-b045-350c8cb5e1f8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:52.366607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:52.367242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:52.367520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:52.367816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] PATH_INFO: `/v3/users/d590e56c4a204a2e81efda1a05d261ce` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:52.368977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] RBAC: Authorizing `identity:get_user(user_id=d590e56c4a204a2e81efda1a05d261ce)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:52.370556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:52.372190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 566/1127] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:52:52 2022] GET /identity/v3/users/d590e56c4a204a2e81efda1a05d261ce => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:52.378083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:52.476948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d03b-3023-4bfc-a528-cb502fe3452a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:52.509132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:52.509831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:52.510108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:52.510890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:52.525168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:52.579275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:52.580794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:52.681820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 562/1128] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:52:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:52:52.688062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:52.785849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96e492-cf0a-4c73-b4a4-93f701b311b1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:52.819213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:52.819869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:52.820146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:52.820414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] PATH_INFO: `/v3/projects/9943f4a6af5744f2bb8edf5f70526173` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:52.821543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] RBAC: Authorizing `identity:get_project(project_id=9943f4a6af5744f2bb8edf5f70526173)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:52.823137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32186-f55e-488c-8ebd-789322ed3300 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:52.824903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 567/1129] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:52:52 2022] GET /identity/v3/projects/9943f4a6af5744f2bb8edf5f70526173 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:52.831135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:52.876182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:52.929249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98bbf0-7c24-49f5-bfb2-237da63f8b39 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:52.966785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:52.967394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:52.967972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:52.967972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:52.968728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] RBAC: Adding query filter params (role.id=0833044dd2f8488aab51a45b7ea352a8, scope.project.id=9943f4a6af5744f2bb8edf5f70526173, user.id=d590e56c4a204a2e81efda1a05d261ce) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:52:52.969027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:52.970471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39cad0-fd74-4e0b-8dd9-9402b25c1e40 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:52.976322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 563/1130] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:52:52 2022] GET /identity/v3/role_assignments?user.id=d590e56c4a204a2e81efda1a05d261ce&scope.project.id=9943f4a6af5744f2bb8edf5f70526173&role.id=0833044dd2f8488aab51a45b7ea352a8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:54.996185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911b91-f353-4255-b9dd-5650419b804a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:54.996737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911b91-f353-4255-b9dd-5650419b804a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:54.996737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911b91-f353-4255-b9dd-5650419b804a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:54.998077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 568/1131] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:55.003609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:55.004071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:55.004237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:55.023253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:55.024732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:55.090194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 564/1132] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:52:55.113883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db911b91-f353-4255-b9dd-5650419b804a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:55.150088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:55.215064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db911b91-f353-4255-b9dd-5650419b804a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:55.248144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:55.248677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:55.248948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:55.249214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:55.250345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:55.251742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154fb75-e59d-41b2-8e52-f4db62504d32 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:55.253361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 569/1133] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:55.259419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:55.299343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:55.357949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba8b3f-282f-41bf-9604-c766bf8616ec None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:55.390208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:55.390806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:55.391078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:55.391345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:55.392029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:55.393436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deb686-3536-4243-9ecc-ee8b43952546 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:55.420914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 565/1134] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:52:55 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:57.446476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd9d3-82cb-4e2b-8cc1-be9aa4cffb1a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:57.446944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd9d3-82cb-4e2b-8cc1-be9aa4cffb1a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:57.447034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd9d3-82cb-4e2b-8cc1-be9aa4cffb1a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:57.448455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 570/1135] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:57.453781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:57.454236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:57.454331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:57.472099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:52:57.473277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:52:57.538302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 566/1136] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:52:57.563977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd9d3-82cb-4e2b-8cc1-be9aa4cffb1a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:57.668715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd9d3-82cb-4e2b-8cc1-be9aa4cffb1a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:57.670972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:57.702523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:57.703082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:57.703377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:57.703645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:57.704812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:57.706217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d434-2277-44ac-8e50-c098307d2ffe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:57.707801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 571/1137] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:52:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:52:57.713949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:52:57.735329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:52:57.816541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49644e28-dad9-438f-9bd1-fe049f6def60 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:52:57.849298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:52:57.849902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:57.850175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:57.850442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:57.851117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:52:57.852551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544de2b-267c-4b63-be38-bd15304bfe92 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:52:57.873526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 567/1138] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:52:57 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:52:59.984513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90ad-48a4-4106-9ad4-c8ca058783b2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:59.985039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90ad-48a4-4106-9ad4-c8ca058783b2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:59.985039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90ad-48a4-4106-9ad4-c8ca058783b2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:52:59.986404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 572/1139] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:52:59.991671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:52:59.992123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:52:59.992249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:00.010777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:00.011984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:00.077037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 568/1140] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:52:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:00.101153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c90ad-48a4-4106-9ad4-c8ca058783b2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:00.205096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c90ad-48a4-4106-9ad4-c8ca058783b2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:00.240286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:00.240853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:00.241134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:00.241408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:00.251978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:00.256838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:00.257998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:00.258925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 573/1141] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:53:00.264949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:00.273269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:00.370486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f23b-6dba-4323-808e-6735691df0d9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:00.404443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:00.405052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:00.405327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:00.405594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:00.406299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:00.406598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:00.407973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:00.416724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 569/1142] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:53:00.424553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:00.466420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:00.538682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aed6d1-791f-41ed-b670-e681f377a9a2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:00.574491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:00.575131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:00.575409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:00.575680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] PATH_INFO: `/v3/users/b14218e6abe04ecba5150836b8a8ba1f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:00.589450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] RBAC: Authorizing `identity:get_user(user_id=b14218e6abe04ecba5150836b8a8ba1f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:00.590879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:00.592641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 574/1143] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:00 2022] GET /identity/v3/users/b14218e6abe04ecba5150836b8a8ba1f => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:00.598491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:00.680011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:00.717220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91fda-629d-4c2b-a36f-337a574bd41d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:00.749641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:00.750247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:00.750524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:00.750793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:00.816493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:00.817839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:00.879541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:00.913172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 570/1144] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:53:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:00.919174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:01.023877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:01.036768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4a7d-8c08-4565-a72d-507e7060959c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:01.070508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:01.071070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:01.071345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:01.071617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] PATH_INFO: `/v3/projects/1d5b80156d3144dea50b95efa1555414` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:01.072932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5b80156d3144dea50b95efa1555414)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:01.074347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b0d3-d425-4be5-9d12-f95a60a82713 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:01.076043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 575/1145] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:00 2022] GET /identity/v3/projects/1d5b80156d3144dea50b95efa1555414 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:01.082243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:01.180175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847f21-3d1e-4b48-b98f-8daf3fba32f3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:01.213822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:01.214429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:01.214706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:01.214975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:01.215757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1d5b80156d3144dea50b95efa1555414, user.id=b14218e6abe04ecba5150836b8a8ba1f) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:01.216091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:01.217509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b4432-038e-4afd-90d2-0218d220611d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:01.222842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 571/1146] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:53:01 2022] GET /identity/v3/role_assignments?user.id=b14218e6abe04ecba5150836b8a8ba1f&scope.project.id=1d5b80156d3144dea50b95efa1555414&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:03.216970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29077a-23d4-4a67-8417-8f7b2b27da8b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.217532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29077a-23d4-4a67-8417-8f7b2b27da8b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.217532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29077a-23d4-4a67-8417-8f7b2b27da8b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.218837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 576/1147] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:03.224016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.224408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.224572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.242555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:03.244638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:03.270518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:03.311953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 572/1148] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:03.334589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29077a-23d4-4a67-8417-8f7b2b27da8b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:03.441367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29077a-23d4-4a67-8417-8f7b2b27da8b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:03.476044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:03.476593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.476862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.477124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.487288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:03.492499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:03.494387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:03.495243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 577/1149] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:03.500448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:03.595199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e390e-d89e-4949-81c6-cfc2ce573c0f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:03.629018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:03.629630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.629907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.630178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.630882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:03.631223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:03.632580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:03.640511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 573/1150] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:03.646400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:03.666190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:03.745223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432711f-9b1f-4326-8e38-685c8d35e94a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:03.778110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:03.778737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.779090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.779363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] PATH_INFO: `/v3/users/b14218e6abe04ecba5150836b8a8ba1f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.780545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=b14218e6abe04ecba5150836b8a8ba1f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:03.781955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:03.783540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 578/1151] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:03 2022] GET /identity/v3/users/b14218e6abe04ecba5150836b8a8ba1f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:03.789361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:03.815439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:03.889797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5f95-a699-475d-af55-c63d78d745a5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:03.923442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:03.924112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:03.924383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:03.924647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] PATH_INFO: `/v3/projects/1d5b80156d3144dea50b95efa1555414` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:03.925781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5b80156d3144dea50b95efa1555414)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:03.927183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af9f5-ac53-4038-895b-f8ef74cc2c41 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:03.928844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 574/1152] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:03 2022] GET /identity/v3/projects/1d5b80156d3144dea50b95efa1555414 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:03.934782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:04.021318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:04.037150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61ff61-bc6d-4cfb-bada-ef0e0a2ae9d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:04.070433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:04.071285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:04.071857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:04.072399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] PATH_INFO: `/v3/projects/1d5b80156d3144dea50b95efa1555414/users/b14218e6abe04ecba5150836b8a8ba1f/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:04.075921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d5b80156d3144dea50b95efa1555414, user_id=b14218e6abe04ecba5150836b8a8ba1f, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:04.078668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29da6d9-6278-40ea-a75d-f826e4951614 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:04.093333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 579/1153] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:53:03 2022] PUT /identity/v3/projects/1d5b80156d3144dea50b95efa1555414/users/b14218e6abe04ecba5150836b8a8ba1f/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:53:06.146325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5870-14a9-4563-b9bf-ce883371ad14 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.146883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5870-14a9-4563-b9bf-ce883371ad14 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.146883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5870-14a9-4563-b9bf-ce883371ad14 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.148514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 575/1154] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:06.155104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.155536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.155642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.178351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:06.179527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:06.245385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 580/1155] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:06.268000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b5870-14a9-4563-b9bf-ce883371ad14 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:06.360404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:06.370789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b5870-14a9-4563-b9bf-ce883371ad14 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:06.403874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:06.404439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.404717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.404989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.415340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:06.420413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:06.421538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:53:06.422539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 576/1156] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:06.427802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:06.503347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:06.532805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ec71-8d11-4ade-8ea0-743874760d1d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:06.565649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:06.566257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.566532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.566803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.567510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:06.567831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:06.569222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:06.577943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 581/1157] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:06.583742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:06.681713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd980dc6-8c52-49d5-912b-ee901945c309 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:06.715370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:06.716024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.716303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.716576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] PATH_INFO: `/v3/users/b14218e6abe04ecba5150836b8a8ba1f` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.717717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] RBAC: Authorizing `identity:get_user(user_id=b14218e6abe04ecba5150836b8a8ba1f)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:06.719131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:06.720750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 577/1158] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:06 2022] GET /identity/v3/users/b14218e6abe04ecba5150836b8a8ba1f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:06.726520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:06.825566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ddd79-6efc-4b01-a5d2-87a1f837f212 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:06.857460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:06.858068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:06.858345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:06.858615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:06.866811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:06.924416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:06.925846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:07.021737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 582/1159] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:53:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:07.028056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:07.050191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:07.125301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165207-15dc-4140-b76f-146fc22ab741 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:07.157941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:07.158567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:07.158827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:07.159093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] PATH_INFO: `/v3/projects/1d5b80156d3144dea50b95efa1555414` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:07.160251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] RBAC: Authorizing `identity:get_project(project_id=1d5b80156d3144dea50b95efa1555414)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:07.161641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4efa-78a4-4758-9f68-5621996bc32e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:07.163266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 578/1160] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:07 2022] GET /identity/v3/projects/1d5b80156d3144dea50b95efa1555414 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:07.169949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:07.209298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:07.267458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd20cd-5934-45a0-bcd7-f812037827dd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:07.300534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:07.301073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:07.301348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:07.301615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:07.302390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1d5b80156d3144dea50b95efa1555414, user.id=b14218e6abe04ecba5150836b8a8ba1f) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:07.302692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:07.304123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecded856-f785-4554-baa7-56eadf3636c1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:07.309800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 583/1161] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:53:07 2022] GET /identity/v3/role_assignments?user.id=b14218e6abe04ecba5150836b8a8ba1f&scope.project.id=1d5b80156d3144dea50b95efa1555414&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:09.406856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934c7-21e5-4233-8cb3-0b765c6b900c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:09.407410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934c7-21e5-4233-8cb3-0b765c6b900c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:09.407410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934c7-21e5-4233-8cb3-0b765c6b900c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:09.408791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 579/1162] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:09.413980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:09.414923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:09.415016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:09.433425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:09.434602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:09.498063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 584/1163] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:09.519800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de934c7-21e5-4233-8cb3-0b765c6b900c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:09.609742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:09.624080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de934c7-21e5-4233-8cb3-0b765c6b900c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:09.659132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:09.659674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:09.659981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:09.660256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:09.728134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:09.729554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:09.815917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:09.830547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 580/1164] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:53:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:09.837022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:09.866672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:09.932947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4ecb-7821-441b-bda9-08d9d116321a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:09.967310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:09.967966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:09.968238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:09.968504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:09.974873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:09.976319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-91725d0b-d431-4e6c-80a7-ade6c1be06d9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:09.988027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:09.989221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:09.990131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 585/1165] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:53:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:09.995394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:10.094030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb012-d4b9-45c3-859b-b2c0979bbd54 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:10.129406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:10.130012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:10.130287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:10.130556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:10.131232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:10.131528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:10.133042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e4c9-94cd-4896-9a47-24ac1dfad9f8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:10.140257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 581/1166] 10.222.0.95 () {56 vars in 1115 bytes} [Fri Aug 5 19:53:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:12.135159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793bad-e105-4b25-b2c6-b3a895adbc6a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:12.135717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793bad-e105-4b25-b2c6-b3a895adbc6a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:12.135717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793bad-e105-4b25-b2c6-b3a895adbc6a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:12.137073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 586/1167] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:12.142145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266fdc-df4e-491c-b6f8-07af15cc97d5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:12.142552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266fdc-df4e-491c-b6f8-07af15cc97d5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:12.142695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266fdc-df4e-491c-b6f8-07af15cc97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:12.161035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-da266fdc-df4e-491c-b6f8-07af15cc97d5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:12.162220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-da266fdc-df4e-491c-b6f8-07af15cc97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:12.207540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:12.227367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 582/1168] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:12.250702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793bad-e105-4b25-b2c6-b3a895adbc6a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:12.341754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:12.351336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793bad-e105-4b25-b2c6-b3a895adbc6a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:12.384787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:12.385549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:12.385708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:12.385923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:12.386665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:12.387996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35f99-be49-460a-9d77-8417ce6fdaf6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:12.404378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 587/1169] 10.222.0.95 () {60 vars in 1138 bytes} [Fri Aug 5 19:53:12 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:53:14.446562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f807-b0af-425c-afc3-aafc1ced9d4f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:14.447040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f807-b0af-425c-afc3-aafc1ced9d4f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:14.447141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f807-b0af-425c-afc3-aafc1ced9d4f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:14.448483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 583/1170] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:14.453582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:14.453986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:14.454126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:14.472677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:14.473848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:14.550081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 588/1171] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:14.574554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f807-b0af-425c-afc3-aafc1ced9d4f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:14.677954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f807-b0af-425c-afc3-aafc1ced9d4f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:14.711437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:14.712092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:14.712369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:14.712641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] PATH_INFO: `/v3/domains/f884735818b44e22af029201e63c4cc6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:14.723090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f884735818b44e22af029201e63c4cc6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:14.724533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b709d4-7bea-4df2-b82a-38d84187b5b5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:14.726658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 584/1172] 10.222.0.95 () {56 vars in 1183 bytes} [Fri Aug 5 19:53:14 2022] GET /identity/v3/domains/f884735818b44e22af029201e63c4cc6 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:14.732725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:14.810704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:14.830066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6fa8d-9a29-4854-b56c-97b61a1b914d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:14.863157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:14.863769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:14.864072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:14.864339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:14.865016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:14.866415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fb8bb-a115-486e-afc1-82e62c865e5d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:14.894230 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 589/1173] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:53:14 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:53:16.938113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434933c-c657-4f06-a048-7f496eba2cdb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:16.938656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434933c-c657-4f06-a048-7f496eba2cdb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:16.938656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434933c-c657-4f06-a048-7f496eba2cdb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:16.940073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 585/1174] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:16.945498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:16.945924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:16.946045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:16.963675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:16.964951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:17.029703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 590/1175] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:17.054085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434933c-c657-4f06-a048-7f496eba2cdb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:17.097702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:17.153035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434933c-c657-4f06-a048-7f496eba2cdb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:17.185758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:17.186376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:17.186647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:17.186912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] PATH_INFO: `/v3/domains/f884735818b44e22af029201e63c4cc6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:17.188061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f884735818b44e22af029201e63c4cc6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:17.189507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a94dcf-4590-4f57-aa3b-8fb006ba49d8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:17.191027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 586/1176] 10.222.0.95 () {56 vars in 1183 bytes} [Fri Aug 5 19:53:17 2022] GET /identity/v3/domains/f884735818b44e22af029201e63c4cc6 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:17.197108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:17.256205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:17.295215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5490d5-faf9-42be-ae36-10e040658dcd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:17.328177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:17.328782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:17.329060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:17.329344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:17.330009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:17.331402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2311-d364-4c12-88d9-40a47d837832 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:17.353429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 591/1177] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:53:17 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:53:19.515652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fd1d-aef1-4863-89b8-12c07189846d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:19.516222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fd1d-aef1-4863-89b8-12c07189846d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:19.516330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fd1d-aef1-4863-89b8-12c07189846d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:19.517703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 587/1178] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:19.524216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:19.524652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:19.524752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:19.542373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:19.543555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:19.608296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 592/1179] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:19.632786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5fd1d-aef1-4863-89b8-12c07189846d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:19.734757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5fd1d-aef1-4863-89b8-12c07189846d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:19.746232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:19.769530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:19.770150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:19.770676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:19.770944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:19.780656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:19.785453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:19.786605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:53:19.787716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 588/1180] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:19.792697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:19.840973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:19.890232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cbd7f-d156-41be-a20d-d4887ea16269 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:19.923025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:19.923628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:19.923929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:19.924198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:19.924907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:19.925205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:19.926545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:19.934943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 593/1181] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:19.940726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:20.037562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71625d00-275c-4b72-88f0-07625f71d267 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:20.071177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:20.071860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:20.072141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:20.072414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] PATH_INFO: `/v3/users/d0948c05c72a44159c4785059eaa7e55` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:20.085417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] RBAC: Authorizing `identity:get_user(user_id=d0948c05c72a44159c4785059eaa7e55)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:20.086850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:20.088496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 589/1182] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:19 2022] GET /identity/v3/users/d0948c05c72a44159c4785059eaa7e55 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:20.094548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:20.196044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfeb4a6-e847-41aa-a1ad-fd34c876b3cc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:20.208277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:20.230530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:20.231139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:20.231487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:20.231691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:20.298362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:20.299718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:20.395852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 594/1183] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:53:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:20.402469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:20.431428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:20.501335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885494-e2b8-42ec-963b-aa9f1a9e692f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:20.534325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:20.534962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:20.535233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:20.535502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] PATH_INFO: `/v3/projects/8566356e98d444a0b7f7970b5e537ab5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:20.536661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] RBAC: Authorizing `identity:get_project(project_id=8566356e98d444a0b7f7970b5e537ab5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:20.538773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a7446-812f-4cff-bf4f-b6b6fc319d81 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:20.540449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 590/1184] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:20 2022] GET /identity/v3/projects/8566356e98d444a0b7f7970b5e537ab5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:20.546569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:20.560460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:20.644249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9cc95-2ef7-4885-813b-ae0f8caee4e6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:20.682592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:20.683342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:20.683618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:20.683918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:20.685289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=8566356e98d444a0b7f7970b5e537ab5, user.id=d0948c05c72a44159c4785059eaa7e55) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:20.685590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:20.687006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1d88f-8b22-41e0-8342-eea18a1310dd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:20.692488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 595/1185] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:53:20 2022] GET /identity/v3/role_assignments?user.id=d0948c05c72a44159c4785059eaa7e55&scope.project.id=8566356e98d444a0b7f7970b5e537ab5&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:22.664505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36990c8-593c-48e3-809e-7dec4f57217a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:22.665025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36990c8-593c-48e3-809e-7dec4f57217a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:22.665025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36990c8-593c-48e3-809e-7dec4f57217a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:22.666402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 591/1186] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:22.671559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:22.672027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:22.672121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:22.691295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:22.692420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:22.757954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 596/1187] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:53:22.780370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36990c8-593c-48e3-809e-7dec4f57217a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:22.874753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:22.882190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36990c8-593c-48e3-809e-7dec4f57217a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:22.915318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:22.915958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:22.916231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:22.916494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:22.926026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:22.931554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:22.932674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:53:22.933755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 592/1188] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:22.938718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:22.946885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:23.034274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2ae9b-0dc6-4a7a-989e-569d7d894778 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:23.067317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:23.067945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:23.068219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:23.068483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:23.069211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:23.069503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:23.070836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:23.078559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 597/1189] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:23.084773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:23.183151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0290655-4acf-4750-94e4-406e122d5ee4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:23.217015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:23.217577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:23.217849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:23.218116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] PATH_INFO: `/v3/users/d0948c05c72a44159c4785059eaa7e55` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:23.219259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] RBAC: Authorizing `identity:get_user(user_id=d0948c05c72a44159c4785059eaa7e55)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:23.220931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:23.222525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 593/1190] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:23 2022] GET /identity/v3/users/d0948c05c72a44159c4785059eaa7e55 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:23.229069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:23.293237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:23.325745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a049c7-7613-4bae-ac6b-51c71ec0bbb0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:23.357338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:23.357963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:23.358235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:23.358500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] PATH_INFO: `/v3/projects/8566356e98d444a0b7f7970b5e537ab5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:23.359631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] RBAC: Authorizing `identity:get_project(project_id=8566356e98d444a0b7f7970b5e537ab5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:23.361063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c410091-1d05-4404-a885-d8ea0dc05d0a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:23.362707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 598/1191] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:23 2022] GET /identity/v3/projects/8566356e98d444a0b7f7970b5e537ab5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:23.369234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:23.393712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:23.466820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe5239-2e2f-4884-a840-4ec29d053a48 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:23.504420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:23.504995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:23.505267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:23.505535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] PATH_INFO: `/v3/projects/8566356e98d444a0b7f7970b5e537ab5/users/d0948c05c72a44159c4785059eaa7e55/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:23.508125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8566356e98d444a0b7f7970b5e537ab5, user_id=d0948c05c72a44159c4785059eaa7e55, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:23.509562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7f5d-c9ec-4b92-9e2e-5fcc5fb916c8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:23.522381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 594/1192] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:53:23 2022] PUT /identity/v3/projects/8566356e98d444a0b7f7970b5e537ab5/users/d0948c05c72a44159c4785059eaa7e55/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:53:25.503683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14094f5-5130-4888-a153-eabdc2c979e9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:25.504279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14094f5-5130-4888-a153-eabdc2c979e9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:25.504279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14094f5-5130-4888-a153-eabdc2c979e9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:25.505584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 599/1193] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:53:25.511486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:25.512030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:25.512030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:25.530348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:53:25.531517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:53:25.595930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 595/1194] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:53:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:53:25.619115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14094f5-5130-4888-a153-eabdc2c979e9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:25.717453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14094f5-5130-4888-a153-eabdc2c979e9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:25.749251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:25.749871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:25.750142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:25.750413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:25.752955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:25.761966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:53:25.766742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:53:25.767842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:53:25.769076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 600/1195] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:53:25.774770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:25.790036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:25.871238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edc27b-fad2-4d92-a590-a6f4676333b5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:25.904138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:25.904755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:25.905029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:25.905300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:25.906007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:25.906308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:25.907648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:25.916044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 596/1196] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:25.921923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:26.020511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053efe7d-ca37-487b-8d1a-a16737a3c40c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:26.052846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:26.053560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:26.053833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:26.054101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] PATH_INFO: `/v3/users/d0948c05c72a44159c4785059eaa7e55` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:26.055252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] RBAC: Authorizing `identity:get_user(user_id=d0948c05c72a44159c4785059eaa7e55)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:26.056753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:26.058342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 601/1197] 10.222.0.95 () {56 vars in 1177 bytes} [Fri Aug 5 19:53:25 2022] GET /identity/v3/users/d0948c05c72a44159c4785059eaa7e55 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:26.064184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:26.140051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:26.162982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81503db-fb34-4b88-9cd4-ce2884b79aa6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:26.194796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:26.195393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:26.195665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:26.195969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:26.259302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:26.260737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:26.337114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:26.359825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 597/1198] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:53:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:53:26.366548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:26.430183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:26.470280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd14e-97d9-4aa3-97ef-03a5cbadcd14 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:26.505543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:26.507033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:26.507310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:26.507580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] PATH_INFO: `/v3/projects/8566356e98d444a0b7f7970b5e537ab5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:26.508761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] RBAC: Authorizing `identity:get_project(project_id=8566356e98d444a0b7f7970b5e537ab5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:26.510182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24b9c2-ebc0-413d-bb7c-9a1ffe90f281 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:26.511849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 602/1199] 10.222.0.95 () {56 vars in 1186 bytes} [Fri Aug 5 19:53:26 2022] GET /identity/v3/projects/8566356e98d444a0b7f7970b5e537ab5 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:26.518111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:53:26.613311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaecc8-a6e6-465b-8aff-a513d64ee87a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:53:26.647710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:53:26.648341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:53:26.648623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:53:26.648894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:53:26.649669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=8566356e98d444a0b7f7970b5e537ab5, user.id=d0948c05c72a44159c4785059eaa7e55) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:53:26.649974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:53:26.651390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de5afe-de0b-4bcf-b502-9383969a6e9c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:53:26.660440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 598/1200] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:53:26 2022] GET /identity/v3/role_assignments?user.id=d0948c05c72a44159c4785059eaa7e55&scope.project.id=8566356e98d444a0b7f7970b5e537ab5&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:53:36.501422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=34 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:53:36.657752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=80 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:22.475319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f15e7-7698-4d43-a1b9-e50afebd64b9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:22.475319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f15e7-7698-4d43-a1b9-e50afebd64b9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:22.475319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f15e7-7698-4d43-a1b9-e50afebd64b9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:22.475319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 603/1201] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:22.481742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:22.483358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:22.483358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:22.520416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:22.521790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:22.643938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 599/1202] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:22.674067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f15e7-7698-4d43-a1b9-e50afebd64b9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:22.821713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f15e7-7698-4d43-a1b9-e50afebd64b9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:22.871467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:22.872384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:22.872700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:22.873165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:22.887508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:22.890646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:22.908997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:22.910222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:22.918222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:22.918222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:22.918222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:22.918222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:22.918222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 604/1203] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:22.920758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:23.049499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6756a0-a3d4-422a-bc9b-47a94727601f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:23.098110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:23.104831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:23.105697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:23.106010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:23.106305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:23.106977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:23.107333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:23.110017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78174e-3690-4337-8f17-9452ec330bf1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:23.129341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 600/1204] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:23.135825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:23.212820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:23.280502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0ce2b-6350-4147-beee-8a8c2e406d19 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:23.327212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:23.327951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:23.328228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:23.328497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:23.329183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:23.330949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb29893-f258-4dd9-bf44-09499e4764ee None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:23.360256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 605/1205] 10.222.0.95 () {60 vars in 1132 bytes} [Fri Aug 5 19:54:23 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:54:25.619350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be19e6-47d0-414f-9c54-ee7f43e0b03b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:25.619921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be19e6-47d0-414f-9c54-ee7f43e0b03b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:25.619921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be19e6-47d0-414f-9c54-ee7f43e0b03b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:25.621282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 601/1206] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:25.627227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:25.627715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:25.627859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:25.647445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:25.648644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:25.728181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 606/1207] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:25.754008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be19e6-47d0-414f-9c54-ee7f43e0b03b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:25.889309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be19e6-47d0-414f-9c54-ee7f43e0b03b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:25.926680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:25.927314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:25.928385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:25.928385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:25.938503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:25.943382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:25.944868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:25.946158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 602/1208] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:54:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:25.951020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:26.006176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:26.079752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eb414-ab27-4c8f-a5a9-44f0194dbf48 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:26.115898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:26.116538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:26.116795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:26.117057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:26.119314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:26.119314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:26.119504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:26.129858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 607/1209] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:26.135548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:26.193143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:26.252568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c256fa0-a0e9-4954-8844-95b0434e5126 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:26.300482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:26.301103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:26.301448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:26.301689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:26.312966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:26.314401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:26.332072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:26.333050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:26.333969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:26.333969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:26.333969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:26.333969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:26.333969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 603/1210] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:26.339370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:26.465745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:26.469992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1467-9e35-43f0-a97e-37cd1277296c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:26.509933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:26.510586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:26.510896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:26.511242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:26.512004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:26.512662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:26.514675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:26.527919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 608/1211] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:26.533711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:26.658542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a616ee-40ae-49da-8241-ff0856918776 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:26.661240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:26.704162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:26.705049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:26.705485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:26.705899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:26.714240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:26.715676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:26.730313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:26.731363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:26.737772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 604/1212] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:26.738393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:26.865051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b293fe-ef53-4925-bc25-da2aadabd249 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:26.910121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:26.910654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:26.910979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:26.911282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:26.912179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:26.912541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:26.914139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:26.936657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 609/1213] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:26.945889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:27.072226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372a16-72f0-4e3e-8ebc-9e761beda676 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:27.116397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:27.117199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:27.117369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:27.117942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:27.157404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:27.203340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:27.206080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:27.323302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 605/1214] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:54:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:27.331451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:27.355264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:27.457638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ae08-2523-4d91-aaac-1e812f69d345 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:27.500564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:27.501438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:27.501678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:27.502055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:27.515732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:27.517293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:27.535887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:27.536902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:27.537809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:27.537809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:27.537809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:27.537809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:27.537809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 610/1215] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:27.543420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:27.617182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:27.664554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3c9e7-2481-4ae4-8a37-b257f34da390 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:27.703941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:27.704679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:27.704954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:27.705251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:27.706062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:27.706438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:27.708107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:27.721916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 606/1216] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:27.728251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:27.814119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:27.849960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a12cf-3ab1-4d9b-8523-2cc0271894a7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:27.888792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:27.889431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:27.889767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:27.889968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:27.897043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:27.898503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:27.915301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:27.916362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:27.917235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:27.921510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 611/1217] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:27.922440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:28.049401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1416-afd9-48ca-8259-3af5c5219f34 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:28.080349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:28.094277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:28.094918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:28.095156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:28.095418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:28.096274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:28.096544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:28.097943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949da6-1609-4784-b18f-6641af58bf16 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:28.112971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 607/1218] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:28.119583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:28.238649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84971be-ea0a-46c5-950c-3609f10caf9d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:28.274353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:28.283857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:28.284736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:28.285009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:28.285320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:28.286253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b3d6df032d6640deaac623bce31af91e) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:28.286559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:28.287990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da66b-e98b-4e21-93dc-36499b3cdc04 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:28.293796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 612/1219] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:54:28 2022] GET /identity/v3/role_assignments?user.id=b3d6df032d6640deaac623bce31af91e&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:30.372476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c6f8-115e-4a36-b1aa-6d04829f38d9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:30.373091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c6f8-115e-4a36-b1aa-6d04829f38d9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:30.373171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c6f8-115e-4a36-b1aa-6d04829f38d9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:30.374705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 608/1220] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:30.380171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:30.380646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:30.380738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:30.400192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:30.401441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:30.481669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 613/1221] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:30.504509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c6f8-115e-4a36-b1aa-6d04829f38d9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:30.620108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c6f8-115e-4a36-b1aa-6d04829f38d9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:30.660995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:30.661550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:30.661831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:30.662143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:30.674450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:30.680602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:30.681690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:30.688547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 609/1222] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:30.689273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:30.794240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e733e-0fb7-47f5-9e92-209202727b71 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:30.822034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:30.835062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:30.835754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:30.836074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:30.836333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:30.837238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:30.837606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:30.839041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:30.848567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 614/1223] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:54:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:30.854980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:30.903416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:30.964769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01621b5-cd8c-4a8d-a2bc-87beb8b18ea0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.000426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.001143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.001417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.001681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.012622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.014646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:31.031272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:31.032306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:31.033190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:31.033190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:31.033190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:31.033190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:31.033190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 610/1224] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:31.038685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.151425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1a58c-8f6e-4dbd-b1aa-1542e48eabfc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.189244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.190017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.190290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.190558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.191238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:31.191536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.193092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.207726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 615/1225] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:31.214041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.318968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:31.326735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0a8-c345-47a8-bdc0-54e4410979e1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.364249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.364969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.365248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.365518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.374663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.376272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:31.389768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:31.390931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:31.392523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 611/1226] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:54:31.396785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.447580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:31.504312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b0ac-fc66-4275-93c0-b5bc25016535 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.541568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.542180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.542452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.542715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.543497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:31.543814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.545989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.564582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 616/1227] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:31.570204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.682069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519563b9-58fb-4ffb-bd0e-50d02f3aa565 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.724793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.725557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.725913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.726184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.739058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.740710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:31.757789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:31.759041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:31.760361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:31.760361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:31.760361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:31.760361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:31.760361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 612/1228] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 19:54:31.765384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.883272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c38609-c76c-4bdf-81a0-f1ca843ad628 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:31.885671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:31.922034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:31.922794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:31.923101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:31.923396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:31.924259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:31.924583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:31.926038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:31.939191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 617/1229] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:31.945009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:31.955489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:32.066335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07759-b2c0-4ef1-be84-fb8f6c32d194 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:32.105586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:32.106336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:32.106738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:32.107006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:32.116051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:32.117519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:32.130058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:32.131337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:32.132481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 613/1230] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:32.138195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:32.248664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddfd09-4aa1-4b41-8301-0a8c969c7a04 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:32.286551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:32.287186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:32.287573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:32.287887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:32.288639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:32.288944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:32.290356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3a5c-088c-496e-aa6f-5028c8825bdf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:32.303656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 618/1231] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:32.310432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:32.396861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:32.441264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e743-b4ce-4992-a27c-4b4afa6e6ac2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:32.482188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:32.483002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:32.483282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:32.483554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b3d6df032d6640deaac623bce31af91e/roles/c213b2e925d44fca85bd6139653156d3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:32.499454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=b3d6df032d6640deaac623bce31af91e, role_id=c213b2e925d44fca85bd6139653156d3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:32.500944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e909b7-4cb8-41d7-b770-65412d40bc5a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:32.515632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 614/1232] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:54:32 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b3d6df032d6640deaac623bce31af91e/roles/c213b2e925d44fca85bd6139653156d3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:54:34.744511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7050f-3260-42d3-b28f-c98d1195dfda None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:34.745082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7050f-3260-42d3-b28f-c98d1195dfda None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:34.745082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7050f-3260-42d3-b28f-c98d1195dfda None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:34.746442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 619/1233] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:34.751896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:34.752372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:34.752475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:34.770929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:34.772167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:34.839961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 615/1234] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:34.863894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7050f-3260-42d3-b28f-c98d1195dfda None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:34.892545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:34.979305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7050f-3260-42d3-b28f-c98d1195dfda None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.016889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.017696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.017971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.018286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.028902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:35.034611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:35.035847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:35.036780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 620/1235] 10.222.0.95 () {56 vars in 1102 bytes} [Fri Aug 5 19:54:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:35.042469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:35.097078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:35.163901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c863746-0b45-4acd-b914-33b74841ad78 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.198765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.199383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.199663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.199961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.200671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:35.200972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:35.202393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:35.211657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 616/1236] 10.222.0.95 () {56 vars in 1103 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:35.219576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:35.309707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:35.325830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e9ed-50ea-49c9-a7e9-631c3d2572d9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.363135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.363932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.364238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.364511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.375450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:35.377103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:35.394047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:35.395249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:35.396214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:35.396214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:35.396214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:35.396214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:35.396214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 621/1237] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:35.401317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:35.527252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70094594-ff1d-4098-8198-1bd858719eb5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.539932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:35.570406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.570957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.571235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.571507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.572236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:35.572536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:35.573958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:35.588820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 617/1238] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:35.595948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:35.708193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e56f-3f68-4959-82c2-fc4fae84ac97 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.743574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.744251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.744568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.745113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.747701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:35.755061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:35.756744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:35.769631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:35.770780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:35.772416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 622/1239] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:35.777121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:35.903482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c85da5-20cc-4b3d-800f-1d551469beca None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:35.940611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:35.941280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:35.941696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:35.941880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:35.942797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:35.943100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:35.944602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:35.962501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 618/1240] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:35.968922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:36.080303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7704c-9a2a-43c6-b6eb-33788c5a3660 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:36.115663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:36.116455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:36.117005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:36.117150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:36.209818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:36.220778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:36.222685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:36.342998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 623/1241] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:54:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:36.344528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:36.376569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:36.460266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac581e6c-c9da-4289-853b-ac7998623b8d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:36.506155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:36.507150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:36.507586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:36.508085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:36.522443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:36.524831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:36.547063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:36.548237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:36.553584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:36.553584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:36.553584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:36.553584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:36.553584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 619/1242] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:36.554191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:36.661592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:36.669808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1323fb-4784-49ef-ba5a-7d9c058ce637 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:36.710706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:36.711339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:36.711702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:36.712070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:36.712784 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:36.713167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:36.714704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:36.728677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 624/1243] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:36.734488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:36.826673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:36.852090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2634b43-575f-40bb-83a9-ec41bcf0a936 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:36.890034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:36.891638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:36.892022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:36.892298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:36.900223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:36.901831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:36.915728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:36.916833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:36.923001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 620/1244] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:36.923623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:37.041494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12eba-4909-40f5-8f17-8406f6e809e5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:37.079115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:37.079761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:37.080086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:37.080394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:37.081196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:37.081496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:37.083128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3727977-c8fd-4005-94fe-c67dc975ba6d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:37.099147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 625/1245] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:37.105312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:37.219147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a454f-b0ff-4038-b0db-50db05e94cf9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:37.255952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:37.256582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:37.256899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:37.257215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:37.258008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] RBAC: Adding query filter params (role.id=c213b2e925d44fca85bd6139653156d3, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b3d6df032d6640deaac623bce31af91e) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:37.258315 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:37.259725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab7b86-b886-4933-90e2-ee88f4c6cbd6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:37.266784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 621/1246] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:54:37 2022] GET /identity/v3/role_assignments?user.id=b3d6df032d6640deaac623bce31af91e&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=c213b2e925d44fca85bd6139653156d3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:39.454484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358a62-aa6a-410d-ab6e-3049d9193355 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:39.455167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358a62-aa6a-410d-ab6e-3049d9193355 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:39.455167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358a62-aa6a-410d-ab6e-3049d9193355 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:39.456742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 626/1247] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:39.462335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:39.462850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:39.462945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:39.470323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:39.483385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:39.484667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:39.563944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 622/1248] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:39.590042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358a62-aa6a-410d-ab6e-3049d9193355 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:39.614700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:39.710860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358a62-aa6a-410d-ab6e-3049d9193355 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:39.750099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:39.750832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:39.751321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:39.751574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:39.763121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:39.769099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:39.771091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:39.772982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 627/1249] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:39.777058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:39.894763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed58a0-33f4-4e72-8421-f5a56849b1cb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:39.930063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:39.936186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:39.936820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:39.937090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:39.937370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:39.938077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:39.938449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:39.940337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:39.954748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 623/1250] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:39.956167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:40.042014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:40.070174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caccb6-52f7-4516-a238-46ab82026de9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:40.108261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:40.108901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:40.109186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:40.109455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:40.121517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:40.122978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:40.139350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:40.140434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:40.142383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:40.142383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:40.142383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:40.142383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:40.142383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 628/1251] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:40.147119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:40.260845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7656-f374-4f5e-988b-1097ba47384e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:40.299154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:40.299697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:40.300002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:40.300270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:40.300962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:40.301260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:40.302610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:40.314881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 624/1252] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:40.320695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:40.427535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3824-03a4-4c2a-b392-b449a344fb93 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:40.456288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:40.465352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:40.466104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:40.466449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:40.466721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:40.476908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:40.478315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:40.491027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:40.493231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:40.494364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 629/1253] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:40.498266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:40.566240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:40.618191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e026-5d84-4fa8-b51e-e8ca7884b50f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:40.660866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:40.661503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:40.661843 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:40.662142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:40.662950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:40.663250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:40.664697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:40.683461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 625/1254] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:40.689951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:40.800996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c817b-fbe3-4910-a87b-2909e74ba0e9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:40.838763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:40.839377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:40.839655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:40.839956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:40.906906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:40.928351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:40.930039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.050318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 630/1255] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:54:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:41.051752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:41.159857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3cd7b-f270-40ca-b76c-8385e1e6971a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:41.176036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:41.203948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:41.205435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:41.205933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:41.206236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:41.222151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:41.223610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:41.241546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:41.242748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:41.243947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:41.243947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:41.243947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:41.243947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:41.249695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 626/1256] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:41.249899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:41.349927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:41.363545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749afc-fc3f-4ad0-8b4c-998930c2bfe1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:41.402866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:41.403891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:41.404269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:41.404730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:41.405640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:41.406203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:41.408251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.425732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 631/1257] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:41.430563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:41.533789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9508f8-e964-4b17-9026-3d6a2a690d91 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:41.570662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:41.571304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:41.571579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:41.571876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:41.580081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:41.581511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:41.592958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:41.594064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:41.595213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 627/1258] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:41.600896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:41.714245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f978b-e493-4935-965b-6cfad3a4c4da None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:41.758224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:41.758864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:41.759139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:41.759434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:41.760199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:41.760541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:41.761954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af5f92-1aca-4591-bc5b-a4ea9109be78 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.775419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 632/1259] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:41.781547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:41.809846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:41.887811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927cb1-5495-4b14-993a-11276b759e1a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:41.923087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:41.923800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:41.924077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:41.924423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:41.925221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b3d6df032d6640deaac623bce31af91e) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:41.925551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:41.926952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc0e9-6ace-4848-8a41-3a2694df246c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:41.932737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 628/1260] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:54:41 2022] GET /identity/v3/role_assignments?user.id=b3d6df032d6640deaac623bce31af91e&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:43.968367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c0f4-ec43-4a8e-8358-b62032263da7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:43.968908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c0f4-ec43-4a8e-8358-b62032263da7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:43.968908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c0f4-ec43-4a8e-8358-b62032263da7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:43.970233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 633/1261] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:43.975935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:43.976364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:43.976483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:43.994718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:43.995960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:44.060311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 629/1262] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:44.082996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c0f4-ec43-4a8e-8358-b62032263da7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.093742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:44.191537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c0f4-ec43-4a8e-8358-b62032263da7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:44.226199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:44.226760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:44.227037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:44.227304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:44.238427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:44.243298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:44.244434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:44.245479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 634/1263] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:44.250605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.268766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:44.350075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740dfe-8747-44e1-8ddc-3239230db0a5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:44.382334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:44.382935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:44.383208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:44.383476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:44.384203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:44.384503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:44.385835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:44.394723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 630/1264] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:44.400723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.467010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:44.500090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f1a56-e833-4a53-92f3-f57d5054e0eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:44.533283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:44.534535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:44.534808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:44.535077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:44.545202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:44.546624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:44.560321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:44.561353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:44.562254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:44.562254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:44.562254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:44.562254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:44.562254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 635/1265] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:44.567349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.656441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:44.675569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036e405-22ea-4249-88a8-5b707f1cf728 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:44.708085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:44.708687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:44.708984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:44.709248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:44.709918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:44.710211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:44.711557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:44.722937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 631/1266] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:44.728648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.825733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87baa09-8af1-44c3-ba88-0219d22fe8e7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:44.844976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:44.858778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:44.859410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:44.859683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:44.859983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:44.867282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:44.868732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:44.880258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:44.881354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:44.882307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 636/1267] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:44.890024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:44.992928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7e6a-e025-499c-bf0a-50a137babb90 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.026935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.027533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.027824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.028092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.028870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:45.029167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.030572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.039723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:45.048826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 632/1268] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:45.054960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:45.160909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1086f-5c50-4abe-bef3-e2d096e07a58 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.195942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.196575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.196853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.197124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.207480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.208946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:45.222965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:45.224143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:45.225470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:45.225470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:45.225470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:45.225470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:45.225470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 637/1269] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:45.229893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:45.333175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebe92-6eab-4e3c-ab27-9e25692484ea None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.366885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.367531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.367821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.368115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.368812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:45.369105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.370473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.382292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 633/1270] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:45.388045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:45.425075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:45.495173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea831-4e50-4f1b-ad57-56d6617b1b4c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.529293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.529938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.530214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.530502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.538693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.540156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:45.554026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:45.555171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:45.556458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 638/1271] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:45.561075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:45.644542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:45.694811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d7c1e-6ac0-49da-a6c9-1bb0dbefa638 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.730560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.731198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.731478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.731754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.732545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:45.732852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.734294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2b6b-a2e9-4d84-992c-293efb7e2ee5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.747450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 634/1272] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:45.754028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:45.871134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:45.877601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0053f4-cf74-423d-9a86-3e894a24550f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:45.918091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:45.918762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:45.919040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:45.919312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] PATH_INFO: `/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b3d6df032d6640deaac623bce31af91e/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:45.921285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] RBAC: Authorizing `identity:create_grant(project_id=1b90d7b9a40249da9de7a1ce9fd70675, user_id=b3d6df032d6640deaac623bce31af91e, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:45.922717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0ce7-92e4-412f-b7b8-45f9ac6d182e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:45.940181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 639/1273] 10.222.0.95 () {58 vars in 1439 bytes} [Fri Aug 5 19:54:45 2022] PUT /identity/v3/projects/1b90d7b9a40249da9de7a1ce9fd70675/users/b3d6df032d6640deaac623bce31af91e/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 19:54:48.177008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c317-0cba-48e7-9515-d50b9968cbaf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.177565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c317-0cba-48e7-9515-d50b9968cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.177565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c317-0cba-48e7-9515-d50b9968cbaf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.178879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 635/1274] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:48.184200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.184615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.184753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.202488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:48.203685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:48.277189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 640/1275] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:48.301475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c317-0cba-48e7-9515-d50b9968cbaf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:48.403770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c317-0cba-48e7-9515-d50b9968cbaf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:48.421681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:48.439083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:48.439668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.439975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.440247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.451332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 19:54:48.456263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:48.457974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 19:54:48.459074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:48.460163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 636/1276] 10.222.0.95 () {56 vars in 1096 bytes} [Fri Aug 5 19:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:48.464337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:48.542844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:48.561842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03b78-5cb6-4ea5-adec-6180921e9eea None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:48.595933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:48.596545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.596824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.597096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.598102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:48.598433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:48.599808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:48.607591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 641/1277] 10.222.0.95 () {56 vars in 1099 bytes} [Fri Aug 5 19:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:48.613524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:48.712684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaffe0b-dc6a-4346-80ec-238e32895fd6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:48.744323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:48.744946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.745221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.745494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.756232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:48.757643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:48.772085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:48.773147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:48.774087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:48.774087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:48.774087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:48.774087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:48.774087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 637/1278] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:48.779043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:48.875232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce3a9-2a52-4c45-b6e2-478160b04f99 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:48.907918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:48.908527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:48.908803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:48.909072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:48.909761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:48.910093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:48.911561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:48.922959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 642/1279] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:48.929196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:48.959385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:49.027457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0958d-5e43-4029-a309-05af6c08fd0e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:49.059385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:49.060046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:49.060318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:49.060588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:49.068915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:49.071255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 19:54:49.083325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:49.084467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:49.085692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 638/1280] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:49.090526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:49.094316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:49.201362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197032b-b9f3-4c8b-bc1b-0d43cf22ce4c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:49.235140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:49.235749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:49.236054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:49.236321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:49.237097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:49.237458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:49.239740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:49.256924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 643/1281] 10.222.0.95 () {56 vars in 1143 bytes} [Fri Aug 5 19:54:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:49.262930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:49.357183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:49.366423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362ab8-a175-4ecd-8442-f203445e0325 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:49.399689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:49.400304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:49.400576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:49.400841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:49.466555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:49.468009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:49.554091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:49.564466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 639/1282] 10.222.0.95 () {58 vars in 1282 bytes} [Fri Aug 5 19:54:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 19:54:49.571022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:49.630970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:49.668949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f30f8-823b-406b-960e-b5a395fb6f12 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:49.702037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:49.702658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:49.702928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:49.703193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:49.713443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:49.714867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 19:54:49.729801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:49.730932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:49.731917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 19:54:49.731917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 19:54:49.731917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 19:54:49.731917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:49.731917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 644/1283] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:49.737355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:49.837246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef77a2a-1f7a-42ac-8a68-13f57fa71ddc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:49.870955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:49.871554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:49.871856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:49.872126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:49.872803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:49.873099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:49.874447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:49.886198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 640/1284] 10.222.0.95 () {56 vars in 1109 bytes} [Fri Aug 5 19:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:49.891875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:49.990019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62053e34-bac5-461c-9786-4dc5a27ef141 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:50.003056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:50.023287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:50.023953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:50.024279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:50.024622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:50.031089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:50.032540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 19:54:50.044424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:50.045457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 05 19:54:50.046620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 645/1285] 10.222.0.95 () {56 vars in 1111 bytes} [Fri Aug 5 19:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:50.052226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:50.100820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:50.153790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968221-bfa8-49ed-a1ea-3d50df37da9f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:50.186884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:50.187485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:50.187814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:50.188078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:50.188814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:50.189113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:50.190518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf0ef-414e-4075-ab94-9028dc8171d8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:50.201958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 641/1286] 10.222.0.95 () {56 vars in 1148 bytes} [Fri Aug 5 19:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:50.208040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:50.315929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a2b0-d54a-4c4e-b8df-1231a5553e9c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:50.350535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:50.351140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:50.351415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:50.351685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:50.352494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] RBAC: Adding query filter params (role.id=bd74bcf2875d4a938459935e6c4fdc20, scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675, user.id=b3d6df032d6640deaac623bce31af91e) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:50.352800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:50.354217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bebfb-1951-4233-be44-3d0ebd411d2b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:50.359871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 646/1287] 10.222.0.95 () {56 vars in 1374 bytes} [Fri Aug 5 19:54:50 2022] GET /identity/v3/role_assignments?user.id=b3d6df032d6640deaac623bce31af91e&scope.project.id=1b90d7b9a40249da9de7a1ce9fd70675&role.id=bd74bcf2875d4a938459935e6c4fdc20 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:52.429225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ddec7-5252-420b-afad-f0e115a58a29 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:52.429684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ddec7-5252-420b-afad-f0e115a58a29 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:52.429779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ddec7-5252-420b-afad-f0e115a58a29 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:52.431110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 642/1288] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:54:52.436192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:52.436629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:52.436730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:52.454803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:52.456030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:52.485149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:52.522513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 647/1289] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 19:54:52.544342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ddec7-5252-420b-afad-f0e115a58a29 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:52.644140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ddec7-5252-420b-afad-f0e115a58a29 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:52.655465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:52.679950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:52.680509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:52.680780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:52.681046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:52.681656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:52.682986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:52.691556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:52.693344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:52.694391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 643/1290] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:54:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:52.699741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:52.794521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e223c6-9919-49a7-81bb-c3a09e757ae9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:52.827878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:52.828480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:52.828755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:52.829023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:52.829691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:52.829989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:52.831330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605df4d-9866-4c57-be4f-08bf1b55becb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:52.836691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 648/1291] 10.222.0.95 () {56 vars in 1116 bytes} [Fri Aug 5 19:54:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:52.842519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:52.945284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5c68-f809-4d2f-96fe-e5610850f0ee None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:52.977521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:52.978127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:52.978397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:52.978666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:52.979330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:52.979625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:52.980988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb134-9081-458a-a84f-5ef0507f8806 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:52.985312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 644/1292] 10.222.0.95 () {56 vars in 1116 bytes} [Fri Aug 5 19:54:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:54.973926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19308c2d-ed83-4ff2-96b3-b4ff749f5177 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:54.974460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19308c2d-ed83-4ff2-96b3-b4ff749f5177 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:54.974460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19308c2d-ed83-4ff2-96b3-b4ff749f5177 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:54.976387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 649/1293] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:54.981596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5bb83-3a4b-4978-869f-e5dd4057bd28 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:54.982017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5bb83-3a4b-4978-869f-e5dd4057bd28 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:54.982151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5bb83-3a4b-4978-869f-e5dd4057bd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:55.000626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cbf5bb83-3a4b-4978-869f-e5dd4057bd28 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:55.001839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cbf5bb83-3a4b-4978-869f-e5dd4057bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:55.031411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:55.069513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 645/1294] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:55.092080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19308c2d-ed83-4ff2-96b3-b4ff749f5177 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:55.124064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:55.215748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19308c2d-ed83-4ff2-96b3-b4ff749f5177 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:55.250047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:55.250591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:55.250868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:55.251139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:55.251858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:55.253212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c70c0-f78a-4ace-aa5a-2b55641cc094 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:55.267453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 650/1295] 10.222.0.95 () {60 vars in 1141 bytes} [Fri Aug 5 19:54:55 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 19:54:57.278609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462447-3a16-40cf-b8bb-5214538ccb54 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:57.279174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462447-3a16-40cf-b8bb-5214538ccb54 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:57.279174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462447-3a16-40cf-b8bb-5214538ccb54 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:57.280520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 646/1296] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:54:57.285772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:57.286202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:57.286328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:57.304993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:54:57.306322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:54:57.377193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 651/1297] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:54:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:54:57.402081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462447-3a16-40cf-b8bb-5214538ccb54 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:57.505653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462447-3a16-40cf-b8bb-5214538ccb54 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:57.541062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:57.541622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:57.541900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:57.542172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:57.542796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:57.544191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:54:57.552923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:54:57.554169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:54:57.555098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 647/1298] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:54:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:54:57.560673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:57.580162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:57.666193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b46e0f-7d9f-4d77-b189-d2f08c5f8f94 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:57.702161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:57.702762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:57.703035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:57.703300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:57.703989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:57.704284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:57.705625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:57.711232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 652/1299] 10.222.0.95 () {56 vars in 1116 bytes} [Fri Aug 5 19:54:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:54:57.717374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:57.748525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:57.821430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3e84-7e14-481a-9a7d-52e931cbf74b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:57.854153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:57.854763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:57.855040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:57.855309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:57.856083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] RBAC: Adding query filter params (interface=public, service_id=56f566662e2643faa781e2524797de62, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:54:57.856387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:57.857733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b7b1-f20f-476d-bbcc-d82235073f2c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:57.862576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 648/1300] 10.222.0.95 () {56 vars in 1251 bytes} [Fri Aug 5 19:54:57 2022] GET /identity/v3/endpoints?service_id=56f566662e2643faa781e2524797de62&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 19:54:57.868870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:54:57.949634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:54:57.967708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0c463-14d2-4218-89a8-d42a5024e38b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:54:58.000732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:54:58.001342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:54:58.001620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:54:58.001892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:54:58.002533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:54:58.003898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2af09-c29a-447c-8a6d-9772e4631894 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:54:58.011182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 653/1301] 10.222.0.95 () {56 vars in 1087 bytes} [Fri Aug 5 19:54:57 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:55:00.065615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1f5db-95a7-4930-a16a-3f4cd39114bb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:55:00.066147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1f5db-95a7-4930-a16a-3f4cd39114bb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:55:00.066147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1f5db-95a7-4930-a16a-3f4cd39114bb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:55:00.067484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 649/1302] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:55:00.073454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:55:00.073841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:55:00.073995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:55:00.092266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:55:00.093446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:55:00.159159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 654/1303] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:55:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 19:55:00.182492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1f5db-95a7-4930-a16a-3f4cd39114bb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:55:00.275881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:00.282595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1f5db-95a7-4930-a16a-3f4cd39114bb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:55:00.314815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:55:00.315438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:55:00.315763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:55:00.316089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:55:00.316705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:55:00.318254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 19:55:00.327453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 19:55:00.328652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: ERROR keystone.server.flask.application Aug 05 19:55:00.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 650/1304] 10.222.0.95 () {56 vars in 1117 bytes} [Fri Aug 5 19:55:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 19:55:00.334610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:55:00.411262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:00.436277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039739e-302d-458c-8771-1b8a404af4ba None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:55:00.471524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:55:00.472162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:55:00.472434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:55:00.472698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:55:00.473361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 19:55:00.473656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:55:00.474993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cf633-92c8-49d8-9bbc-e15b7b603a1d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:55:00.480638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 655/1305] 10.222.0.95 () {56 vars in 1116 bytes} [Fri Aug 5 19:55:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 19:55:00.486530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:55:00.586650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1938e-184f-48d7-93b6-aea63382a86f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:55:00.619528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:55:00.620159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:55:00.620437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:55:00.620706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:55:00.621491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:55:00.622880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042df530-0a1d-45cc-8c17-cc2c3a954cd7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:55:00.642118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 651/1306] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 19:55:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 19:55:10.477514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=30 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:10.638287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:04.343721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd90e9-9836-4028-84a9-4ab341200114 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:04.344310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd90e9-9836-4028-84a9-4ab341200114 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:04.344310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd90e9-9836-4028-84a9-4ab341200114 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:04.349531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 656/1307] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:04.352154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3999-49ef-48d4-b0e1-cfbf4ebbd45b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:04.353134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3999-49ef-48d4-b0e1-cfbf4ebbd45b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:04.353635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3999-49ef-48d4-b0e1-cfbf4ebbd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:04.451909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a29e3999-49ef-48d4-b0e1-cfbf4ebbd45b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:04.453127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a29e3999-49ef-48d4-b0e1-cfbf4ebbd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:04.572419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 652/1308] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:04.658093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:04.658293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:04.658578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:04.660227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 657/1309] 10.222.0.95 () {54 vars in 965 bytes} [Fri Aug 5 19:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:04.667766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503d51-e298-4a84-a453-6fea168cee19 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:04.668175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503d51-e298-4a84-a453-6fea168cee19 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:04.668369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503d51-e298-4a84-a453-6fea168cee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:04.749547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-89503d51-e298-4a84-a453-6fea168cee19 None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:04.750756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89503d51-e298-4a84-a453-6fea168cee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:04.784825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:04.850082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 653/1310] 10.222.0.95 () {58 vars in 1062 bytes} [Fri Aug 5 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:04.859302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:04.861383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:04.974206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f492ee-f099-4218-b2a1-9e00343536d4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:05.053826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:05.054441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:05.054717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:05.054980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:05.056635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:05.114495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:05.175519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:05.176966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2804272-f61c-4f9d-aac8-0fae08acce96 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:05.197574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 658/1311] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:07.549475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:07.550053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:07.550053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:07.551370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 654/1312] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:07.557264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4f3-a6fd-44ea-968c-a37b7921ef16 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:07.557689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4f3-a6fd-44ea-968c-a37b7921ef16 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:07.557817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4f3-a6fd-44ea-968c-a37b7921ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:07.639634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3224f4f3-a6fd-44ea-968c-a37b7921ef16 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:07.640872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3224f4f3-a6fd-44ea-968c-a37b7921ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:07.747479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 659/1313] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:07.785821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:07.788051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:07.911418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768765-887a-4f18-88c9-ab9babe8dc75 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:07.993879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:07.996594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:07.997218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:07.997495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:07.997843 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:08.000059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:08.136725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:08.138393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ea54-ffe7-4e65-9b1c-96a4654e8b8b service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:08.159178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 655/1314] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:10.550452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:10.550960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:10.550960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:10.552293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 660/1315] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:10.558039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0b4d-6010-4019-91d3-7e66efc385e8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:10.558551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0b4d-6010-4019-91d3-7e66efc385e8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:10.558551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0b4d-6010-4019-91d3-7e66efc385e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:10.622876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ceac0b4d-6010-4019-91d3-7e66efc385e8 None None] MFA Rules not processed for user `6c7702e037e4487b83ac077b5c7f1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:10.624182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ceac0b4d-6010-4019-91d3-7e66efc385e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:10.675478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:10.719465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 656/1316] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:10.759796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:10.761334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:10.770795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:10.862953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876dc1-cdb0-460a-b8c2-587b7012b4a9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:10.934688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:10.935278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:10.935549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:10.935836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:10.937439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:10.997939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:11.045545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:11.046959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309792a2-0b37-4a0c-9844-72f662fbfc03 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:11.065152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 661/1317] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:13.653630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474080-85fe-46b8-8e2b-7c9e41d4894a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:13.654160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474080-85fe-46b8-8e2b-7c9e41d4894a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:13.654160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474080-85fe-46b8-8e2b-7c9e41d4894a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:13.655517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 657/1318] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:13.660691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837abd-ff06-4e40-b8b3-54f090b54692 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:13.661125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837abd-ff06-4e40-b8b3-54f090b54692 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:13.661213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837abd-ff06-4e40-b8b3-54f090b54692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:13.726525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-88837abd-ff06-4e40-b8b3-54f090b54692 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:13.727621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88837abd-ff06-4e40-b8b3-54f090b54692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:13.820674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 662/1319] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:56:13.876182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:13.876461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:13.876733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:13.878075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 658/1320] 10.222.0.95 () {54 vars in 965 bytes} [Fri Aug 5 19:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:13.884581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd006e-84e3-4c11-b81a-4e9339346b3a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:13.884862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd006e-84e3-4c11-b81a-4e9339346b3a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:13.885129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd006e-84e3-4c11-b81a-4e9339346b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:13.907029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:13.962848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f9bd006e-84e3-4c11-b81a-4e9339346b3a None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:13.964061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f9bd006e-84e3-4c11-b81a-4e9339346b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:14.039547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 663/1321] 10.222.0.95 () {58 vars in 1062 bytes} [Fri Aug 5 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:14.048661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:14.050289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:14.155719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319b6ae-252f-4b33-9132-49aa9c29720b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:14.227566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:14.228203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:14.228479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:14.228746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:14.230505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:14.237657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:14.338565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:14.339917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a09aff-5c62-4067-81da-5c246a769eb2 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:14.359295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 659/1322] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:17.518923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:17.519551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:17.519551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:17.520866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 664/1323] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:17.526114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3044-d042-4d0d-b196-b5141b649df8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:17.526595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3044-d042-4d0d-b196-b5141b649df8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:17.526692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3044-d042-4d0d-b196-b5141b649df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:17.596172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-045a3044-d042-4d0d-b196-b5141b649df8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:17.597370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-045a3044-d042-4d0d-b196-b5141b649df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:17.662417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:17.708812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 660/1324] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:17.747369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:17.749000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:17.861311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50a4e3-aea7-41dc-b466-cb9ed727e2e6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:17.873701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:17.935608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:17.936252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:17.936546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:17.936800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:17.938405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:18.048083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:18.049444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92237b2-e244-4a49-9ab4-e0539628acb8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:18.067901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 665/1325] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:20.142200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:20.142735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:20.143169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:20.145164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 661/1326] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:20.151555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e397-3b62-4e9b-bed3-27bd52ff2c04 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:20.152070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e397-3b62-4e9b-bed3-27bd52ff2c04 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:20.152173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e397-3b62-4e9b-bed3-27bd52ff2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:20.200714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:20.220140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8502e397-3b62-4e9b-bed3-27bd52ff2c04 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:20.221333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8502e397-3b62-4e9b-bed3-27bd52ff2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:20.321077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 666/1327] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:56:20.358209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:20.359866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:20.468896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09ccc5-5136-44af-aa83-dcf53097a4d8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:20.546108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:20.546727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:20.546995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:20.547254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:20.548898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:20.565904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:20.668142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:20.669891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50cb10-dec0-4939-b97a-5fad13f8bfea service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:20.688447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 662/1328] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:22.825360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:22.825924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:22.825924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:22.827280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 667/1329] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:22.832854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f66d4-1da0-43c0-b773-a1d9a53a0f74 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:22.833322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f66d4-1da0-43c0-b773-a1d9a53a0f74 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:22.833477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f66d4-1da0-43c0-b773-a1d9a53a0f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:22.904985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f14f66d4-1da0-43c0-b773-a1d9a53a0f74 None None] MFA Rules not processed for user `6c7702e037e4487b83ac077b5c7f1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:22.906208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f14f66d4-1da0-43c0-b773-a1d9a53a0f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:22.972812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:23.006866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 663/1330] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:23.045788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:23.047318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:23.159107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf6767-bce2-4822-bc3f-f3bfdd7f7772 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:23.187155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:23.245692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:23.246225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:23.246498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:23.246765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:23.248621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:23.365104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:23.366571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf991278-51f9-4b64-bc28-be15545e54bc service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:23.385240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 668/1331] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:25.721914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:25.722479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:25.722479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:25.723810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 664/1332] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:25.729459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32792-6943-4af8-9cd6-cf580a85d85b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:25.729867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32792-6943-4af8-9cd6-cf580a85d85b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:25.730002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32792-6943-4af8-9cd6-cf580a85d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:25.793835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:25.796824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60f32792-6943-4af8-9cd6-cf580a85d85b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:25.798649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60f32792-6943-4af8-9cd6-cf580a85d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:25.896362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 669/1333] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:25.933940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:25.935524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:26.037131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd930-92b2-4f3c-a892-4af1d1a557cf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:26.109810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:26.110421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:26.110696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:26.110965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:26.112593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:26.140745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:26.221669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:26.223107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e889a-532a-4d7e-9818-381eed3c4885 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:26.241460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 665/1334] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:28.344983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:28.345512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:28.345512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:28.346857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 670/1335] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:28.352052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307b85-0e4e-4c16-93b5-de1d8e87c8cf None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:28.352454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307b85-0e4e-4c16-93b5-de1d8e87c8cf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:28.352643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307b85-0e4e-4c16-93b5-de1d8e87c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:28.430902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3e307b85-0e4e-4c16-93b5-de1d8e87c8cf None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:28.432149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3e307b85-0e4e-4c16-93b5-de1d8e87c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:28.504601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:28.528330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 666/1336] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:28.568758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:28.570318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:28.675118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a8381-101d-421b-b9f1-247812d24167 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:28.703270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:28.748495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:28.749109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:28.749380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:28.749644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:28.751248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:28.859533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:28.860900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63600f-b58d-474f-8b1e-5e27564cd16e service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:28.878629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 671/1337] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:31.254379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:31.254854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:31.254972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:31.256331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 667/1338] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:31.262709 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127b49-c30e-430f-b095-1060c737d34b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:31.263162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127b49-c30e-430f-b095-1060c737d34b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:31.263257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127b49-c30e-430f-b095-1060c737d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:31.329129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-57127b49-c30e-430f-b095-1060c737d34b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:31.330322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-57127b49-c30e-430f-b095-1060c737d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:31.338636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:31.426697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 672/1339] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:31.465147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:31.466671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:31.569288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c93f73-2390-45e8-bff0-8f996b54b55e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:31.642585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:31.643201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:31.643474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:31.643743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:31.645378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:31.680774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:31.756416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:31.757872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d784de0-02ad-40bc-9865-e2d58d689d66 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:31.777781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 668/1340] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:35.887945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:35.888507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:35.888507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:35.889847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 673/1341] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:35.895156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbe04-1156-441b-bfe1-b554cc43d4c8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:35.895600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbe04-1156-441b-bfe1-b554cc43d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:35.895805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbe04-1156-441b-bfe1-b554cc43d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:35.964329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4a6cbe04-1156-441b-bfe1-b554cc43d4c8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:35.965465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4a6cbe04-1156-441b-bfe1-b554cc43d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:36.061540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:36.073695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 669/1342] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:36.113282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:36.114792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:36.223772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19915c3d-5caa-4612-985f-a17ab272081f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:36.263158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:36.300349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:36.300969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:36.301240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:36.301502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:36.303115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:36.415272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:36.417547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358de92-e820-4f9e-ad2d-69e082e11bc3 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:36.437219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 674/1343] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:39.159496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:39.160039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:39.160128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:39.161433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 670/1344] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:56:39.167990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86ee37-5835-42ed-9710-441d1bca512b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:39.168374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86ee37-5835-42ed-9710-441d1bca512b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:39.168614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86ee37-5835-42ed-9710-441d1bca512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:39.244579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2b86ee37-5835-42ed-9710-441d1bca512b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:39.245897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b86ee37-5835-42ed-9710-441d1bca512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:39.264243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:39.347515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 675/1345] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:39.385963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:39.387503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:39.506249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372c367-d7df-44ff-8c54-e0aa23f336be None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:39.583441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:39.584090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:39.584365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:39.584635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:39.586233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:39.629077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:39.695739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:39.697113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097e44d-96d4-4735-8d2d-ffc8ca81e79a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:39.716043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 671/1346] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:43.981980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:43.982431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:43.982508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:43.985178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 676/1347] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:43.989691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0baf-e316-4e37-a819-d1b8f1fb12a4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:43.990148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0baf-e316-4e37-a819-d1b8f1fb12a4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:43.990230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff0baf-e316-4e37-a819-d1b8f1fb12a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:44.073800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3aff0baf-e316-4e37-a819-d1b8f1fb12a4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:44.075025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3aff0baf-e316-4e37-a819-d1b8f1fb12a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:44.180947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:44.189554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 672/1348] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:44.223510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:44.225160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:44.350921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0149-4f97-4598-98cd-7e48710b6ef7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:56:44.405999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:44.439598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:56:44.440268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:44.440544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:44.440812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:44.442452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:44.571873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:56:44.573920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5fab0-04f7-4422-86ce-54c2bc117f92 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:56:44.595994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 677/1349] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:49.619620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20a50-4fb7-41a0-b4f5-2267137208c5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:49.620324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20a50-4fb7-41a0-b4f5-2267137208c5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:49.620756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20a50-4fb7-41a0-b4f5-2267137208c5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:49.622483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 673/1350] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 19:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:49.628825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9eb5-b494-4dfb-a0c4-7051a3c6b2d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:49.629662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9eb5-b494-4dfb-a0c4-7051a3c6b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:49.630085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9eb5-b494-4dfb-a0c4-7051a3c6b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:49.759442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bb6f9eb5-b494-4dfb-a0c4-7051a3c6b2d7 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:49.760851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bb6f9eb5-b494-4dfb-a0c4-7051a3c6b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:49.779492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:49.880311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 678/1351] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 19:56:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:54.302100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b172-c63f-4aba-b91f-55eb0eeb1dfb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:54.302624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b172-c63f-4aba-b91f-55eb0eeb1dfb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:54.302624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b172-c63f-4aba-b91f-55eb0eeb1dfb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:54.304374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 674/1352] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 19:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:54.309606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b5bd-3dbf-4511-b37c-0e0612d98861 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:54.310064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b5bd-3dbf-4511-b37c-0e0612d98861 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:54.310145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b5bd-3dbf-4511-b37c-0e0612d98861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:54.399553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-76a7b5bd-3dbf-4511-b37c-0e0612d98861 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:54.400779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-76a7b5bd-3dbf-4511-b37c-0e0612d98861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:54.499083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:54.538955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 679/1353] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 19:56:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:55.628800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4fa9-7582-42d6-9477-e2dcbc77e9ea None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:55.629316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4fa9-7582-42d6-9477-e2dcbc77e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:55.629316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4fa9-7582-42d6-9477-e2dcbc77e9ea None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:55.630607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 675/1354] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 19:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:55.635678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847f96-1b13-4538-8863-776d0e32b819 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:55.636687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847f96-1b13-4538-8863-776d0e32b819 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:55.636881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847f96-1b13-4538-8863-776d0e32b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:55.715618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e8847f96-1b13-4538-8863-776d0e32b819 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:55.716876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8847f96-1b13-4538-8863-776d0e32b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:55.824867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 680/1355] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 19:56:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:56:59.341473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4af3-5052-49a8-bcab-2f79816b2366 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:59.342419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4af3-5052-49a8-bcab-2f79816b2366 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:59.342906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4af3-5052-49a8-bcab-2f79816b2366 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:59.349435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 676/1356] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:56:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:59.350827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdcd6-2ec7-430e-8f94-b1da21f7f271 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:59.351290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdcd6-2ec7-430e-8f94-b1da21f7f271 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:59.351388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdcd6-2ec7-430e-8f94-b1da21f7f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:59.393731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:59.434170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1eacdcd6-2ec7-430e-8f94-b1da21f7f271 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:59.435379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1eacdcd6-2ec7-430e-8f94-b1da21f7f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:59.557678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 681/1357] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:56:59.614031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:59.614938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:59.615566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:59.617645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 677/1358] 10.222.0.95 () {54 vars in 962 bytes} [Fri Aug 5 19:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:56:59.626068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee988bc-0b30-4a41-b578-060f9550f300 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:56:59.626352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee988bc-0b30-4a41-b578-060f9550f300 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:56:59.626643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee988bc-0b30-4a41-b578-060f9550f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:56:59.714992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9ee988bc-0b30-4a41-b578-060f9550f300 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:56:59.716205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9ee988bc-0b30-4a41-b578-060f9550f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:56:59.768531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:59.841765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 682/1359] 10.222.0.95 () {58 vars in 1059 bytes} [Fri Aug 5 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:56:59.849471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:56:59.850958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:00.005551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c516d-8110-46f9-b0c6-0d63834a952a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:00.088084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:00.133291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:00.133818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:00.134109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:00.134361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:00.136041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:00.232202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:00.233851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42d41c-7ab9-4d83-878e-7f114aa8af5b service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:00.254216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 678/1360] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:02.512814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:02.513328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:02.513328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:02.514804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 683/1361] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:02.519832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e0ff-e300-48f7-821a-57959f976933 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:02.520289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e0ff-e300-48f7-821a-57959f976933 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:02.520372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e0ff-e300-48f7-821a-57959f976933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:02.593991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cb50e0ff-e300-48f7-821a-57959f976933 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:02.595186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cb50e0ff-e300-48f7-821a-57959f976933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:02.635497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:02.699425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 679/1362] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:02.744604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:02.746477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:02.931549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22434d-ad3f-412b-9725-dcaf071f1902 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:02.941943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.067969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:03.068677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:03.068677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:03.069109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:03.070702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:03.176313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:03.178100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346b3f-5cab-49e3-8fd1-5adc809ad17e service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:03.199560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 684/1363] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:05.632721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16713cb-65b1-4c26-8ccb-000c099c1813 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:05.633264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16713cb-65b1-4c26-8ccb-000c099c1813 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:05.633264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16713cb-65b1-4c26-8ccb-000c099c1813 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:05.634549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 680/1364] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:05.640721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0a03-490c-4ea9-9a42-187153d2d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:05.641236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0a03-490c-4ea9-9a42-187153d2d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:05.641709 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0a03-490c-4ea9-9a42-187153d2d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:05.659279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:05.726016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a5c0a03-490c-4ea9-9a42-187153d2d5d2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:05.726016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a5c0a03-490c-4ea9-9a42-187153d2d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:05.834758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 685/1365] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:05.881159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:05.882039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:05.882409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:05.883951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 681/1366] 10.222.0.95 () {54 vars in 962 bytes} [Fri Aug 5 19:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:05.890025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71f28-6f7b-4954-b200-db817a1622dc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:05.890025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71f28-6f7b-4954-b200-db817a1622dc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:05.890283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71f28-6f7b-4954-b200-db817a1622dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:05.970304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a6b71f28-6f7b-4954-b200-db817a1622dc None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:05.972246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6b71f28-6f7b-4954-b200-db817a1622dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:06.009415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:06.103290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 686/1367] 10.222.0.95 () {58 vars in 1059 bytes} [Fri Aug 5 19:57:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:06.111719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:06.113337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:06.284171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca93a21-3510-4c01-aa2d-9e7f57471ea5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:06.306487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:06.409784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:06.410434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:06.410710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:06.410977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:06.412640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:06.521227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:06.523310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927102-af0c-413f-9685-c79bb97304bb service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:06.547622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 682/1368] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:07.616201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083730-ab11-4242-8e93-3b5d65ea1328 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:07.616725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083730-ab11-4242-8e93-3b5d65ea1328 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:07.616725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083730-ab11-4242-8e93-3b5d65ea1328 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:07.618103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 687/1369] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:07.624644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6c49-629a-4775-a116-aaea3102f278 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:07.625124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6c49-629a-4775-a116-aaea3102f278 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:07.625205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6c49-629a-4775-a116-aaea3102f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:07.659610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:07.699137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-eb9f6c49-629a-4775-a116-aaea3102f278 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:07.700644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eb9f6c49-629a-4775-a116-aaea3102f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:07.812829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 683/1370] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:08.160030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:08.160315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:08.161301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:08.162111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 688/1371] 10.222.0.95 () {54 vars in 964 bytes} [Fri Aug 5 19:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:08.166922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace4c8-4c40-436e-8abb-9c8c953d1d57 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:08.167268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace4c8-4c40-436e-8abb-9c8c953d1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:08.167607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace4c8-4c40-436e-8abb-9c8c953d1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:08.253538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-76ace4c8-4c40-436e-8abb-9c8c953d1d57 None None] MFA Rules not processed for user `2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:08.254982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-76ace4c8-4c40-436e-8abb-9c8c953d1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:08.306546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:08.340792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 684/1372] 10.222.0.95 () {58 vars in 1061 bytes} [Fri Aug 5 19:57:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:08.348428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:08.349933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:08.471182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e807ef-7457-4b1c-85aa-d837077c41a3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:08.517586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:08.555049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:08.555667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:08.556336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:08.556613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:08.558221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:08.682650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:08.685169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:08.699539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7699-0b6f-4cc1-82fa-6ca38eb3503c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:08.700074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7699-0b6f-4cc1-82fa-6ca38eb3503c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:08.700228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7699-0b6f-4cc1-82fa-6ca38eb3503c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:08.705783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 685/1373] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:08.707239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff768fe-400a-4d51-b17d-f6af4e289e7e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:08.707519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff768fe-400a-4d51-b17d-f6af4e289e7e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:08.707820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff768fe-400a-4d51-b17d-f6af4e289e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:08.708049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 689/1374] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:08.803337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fff768fe-400a-4d51-b17d-f6af4e289e7e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:08.805920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fff768fe-400a-4d51-b17d-f6af4e289e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:08.952935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 686/1375] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:09.011188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:09.013468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:09.088548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:09.139186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b87ae-c791-4583-abc2-6d57eb6982d4 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:09.257094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:09.257622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:09.257894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:09.258159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:09.259759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:09.339838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:09.351942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:09.353530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d897-b058-4da6-a6d4-27242a1a0c4e service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:09.373936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 690/1376] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:11.491173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:11.491792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:11.491792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:11.493179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 687/1377] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:11.500556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57a20-54e9-43b0-a54e-87f626e0c691 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:11.501070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57a20-54e9-43b0-a54e-87f626e0c691 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:11.501484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57a20-54e9-43b0-a54e-87f626e0c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:11.581683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aaa57a20-54e9-43b0-a54e-87f626e0c691 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:11.582888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aaa57a20-54e9-43b0-a54e-87f626e0c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:11.688200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 691/1378] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:11.741987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:11.743397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:11.817229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:11.912005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb29c6-e494-4a1c-a89b-19ac393ff887 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:12.035059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:12.035600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:12.035936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:12.036209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:12.037949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:12.050782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:12.142818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:12.144445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c1e9d-2c9b-4e5a-a82f-a1d47c6e86d2 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:12.177832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 688/1379] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:14.303404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:14.304024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:14.304226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:14.305754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 692/1380] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:14.311910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd0e9-64dd-4b23-9979-3f9b1c291d62 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:14.312414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd0e9-64dd-4b23-9979-3f9b1c291d62 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:14.312525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd0e9-64dd-4b23-9979-3f9b1c291d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:14.386052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f03fd0e9-64dd-4b23-9979-3f9b1c291d62 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:14.387286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f03fd0e9-64dd-4b23-9979-3f9b1c291d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:14.490526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:14.504006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 689/1381] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:14.549020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:14.550545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:14.629849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:14.723060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4abfe-25d2-40e8-b2a2-9d509ebfbd57 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:14.843159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:14.843689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:14.843993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:14.844264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:14.845977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:14.878983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:14.956428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:14.958013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c304-13f6-47e0-a080-c834923eded5 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:14.977020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 693/1382] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:17.286210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:17.286755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:17.286901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:17.288695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 690/1383] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:17.294667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88530-7e76-4eeb-8be6-8e0554547719 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:17.295219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88530-7e76-4eeb-8be6-8e0554547719 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:17.295219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88530-7e76-4eeb-8be6-8e0554547719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:17.364492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-23f88530-7e76-4eeb-8be6-8e0554547719 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:17.365715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-23f88530-7e76-4eeb-8be6-8e0554547719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:17.474777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:17.478490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 694/1384] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:17.520951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:17.522477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:17.675871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e5d31-ce18-482a-84cb-c1f21899ee67 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:17.752695 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:17.807454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:17.808106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:17.808379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:17.808649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:17.810474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:17.909917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:17.911532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de598c-0858-46c4-b11d-a999ebebc7a0 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:17.931213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 691/1385] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:20.034559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:20.035247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:20.035247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:20.036497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 695/1386] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:20.042170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444139-97c4-41be-a9a0-dc3d0e7f60eb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:20.042748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444139-97c4-41be-a9a0-dc3d0e7f60eb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:20.042869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444139-97c4-41be-a9a0-dc3d0e7f60eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:20.124829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-27444139-97c4-41be-a9a0-dc3d0e7f60eb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:20.126362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27444139-97c4-41be-a9a0-dc3d0e7f60eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:20.171795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:20.242966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 692/1387] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:20.288602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:20.290163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:20.455533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94714-1706-40b5-80be-413b9b598f2c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:20.538376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:20.588731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:20.589555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:20.589901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:20.590252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:20.593023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:20.690140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:20.691691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261d51-da47-415b-9e2f-05c9217900ad service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:20.711071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 696/1388] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:22.776605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:22.777188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:22.777188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:22.779197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 693/1389] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:22.784809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4e73-b8b9-4336-9fde-6134bb22635f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:22.785508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4e73-b8b9-4336-9fde-6134bb22635f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:22.785508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4e73-b8b9-4336-9fde-6134bb22635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:22.852416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a9ec4e73-b8b9-4336-9fde-6134bb22635f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:22.853606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a9ec4e73-b8b9-4336-9fde-6134bb22635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:22.898522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:22.963642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 697/1390] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:23.022065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:23.023565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:23.172621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64180-11a3-4eff-8450-0e6e57870040 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:23.181619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:23.295468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:23.296383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:23.296659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:23.296927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:23.298531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:23.392246 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:23.393802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a652a-1772-4332-ab17-85e1fb011318 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:23.414591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 694/1391] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:24.331930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fda93-e635-49f1-8b41-2ad015bc5d0c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:24.332499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fda93-e635-49f1-8b41-2ad015bc5d0c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:24.332499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fda93-e635-49f1-8b41-2ad015bc5d0c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:24.333841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 698/1392] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:24.339311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750de0-61b8-450e-8a27-1263f805e27f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:24.339752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750de0-61b8-450e-8a27-1263f805e27f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:24.339873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750de0-61b8-450e-8a27-1263f805e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:24.355997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:24.409345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2e750de0-61b8-450e-8a27-1263f805e27f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:24.410557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2e750de0-61b8-450e-8a27-1263f805e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:24.513043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 695/1393] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:24.570359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:24.570644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:24.570918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:24.572298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 699/1394] 10.222.0.95 () {54 vars in 966 bytes} [Fri Aug 5 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:24.577578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-a72f-4428-909e-a82f8b66fffd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:24.577858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-a72f-4428-909e-a82f8b66fffd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:24.578135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-a72f-4428-909e-a82f8b66fffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:24.662332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-846c416c-a72f-4428-909e-a82f8b66fffd None None] MFA Rules not processed for user `a3e8c4b63db4457aab286cf3f228dd26`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:24.664030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-846c416c-a72f-4428-909e-a82f8b66fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:24.708196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:24.753661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 696/1395] 10.222.0.95 () {58 vars in 1063 bytes} [Fri Aug 5 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:24.761401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:24.763721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:24.869619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99251bca-fb13-4b6a-8a80-1d3fd35ffa13 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:24.933726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:24.946279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:24.946896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:24.947168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:24.947433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:24.949101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:25.066123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:25.067490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33309f7-b95f-42b4-a51a-b47da9c7e52d service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:25.092654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 700/1396] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:25.622223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:25.623074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:25.623074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:25.624281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 697/1397] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:25.629745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae97f-d752-4320-90dd-acd5b1fc22a1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:25.630234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae97f-d752-4320-90dd-acd5b1fc22a1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:25.630596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae97f-d752-4320-90dd-acd5b1fc22a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:25.700498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a18ae97f-d752-4320-90dd-acd5b1fc22a1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:25.701828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a18ae97f-d752-4320-90dd-acd5b1fc22a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:25.750390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:25.816566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 701/1398] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:25.867863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:25.869602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:25.871689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0cc-f8a8-478a-9db2-6b8f715cdd38 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:25.872118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0cc-f8a8-478a-9db2-6b8f715cdd38 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:25.872395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0cc-f8a8-478a-9db2-6b8f715cdd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:25.946415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0800b0cc-f8a8-478a-9db2-6b8f715cdd38 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:25.947899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0800b0cc-f8a8-478a-9db2-6b8f715cdd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:26.035460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325685-f600-41cb-b197-a3782c9a0393 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:26.039648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 702/1399] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:26.080731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:26.084477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0105-4095-4af1-a175-be1c80b39531 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:26.084843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0105-4095-4af1-a175-be1c80b39531 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:26.085177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0105-4095-4af1-a175-be1c80b39531 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:26.086634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 703/1400] 10.222.0.95 () {54 vars in 943 bytes} [Fri Aug 5 19:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 19:57:26.093058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad772-b315-4117-b058-b51f038c220c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:26.093348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad772-b315-4117-b058-b51f038c220c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:26.093618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad772-b315-4117-b058-b51f038c220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:26.141172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:26.157959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:26.158566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:26.158843 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:26.159106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:26.160747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:26.174827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dcdad772-b315-4117-b058-b51f038c220c None None] MFA Rules not processed for user `05de568d5ff94ae6a72ce2d795e408de`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:26.176063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dcdad772-b315-4117-b058-b51f038c220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:26.256219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:26.257824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:26.276776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 698/1401] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:26.286687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 704/1402] 10.222.0.95 () {58 vars in 1040 bytes} [Fri Aug 5 19:57:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:26.297798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:26.299016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:26.349384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:26.398115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5f2a-a1ea-468d-9e4c-22bfaa622dfe service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:26.531808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:26.532411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:26.532997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:26.532997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:26.534560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:26.624364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:26.629055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:26.630648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f72c0-b62e-4d74-a44d-fafe596291e9 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:26.639716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 699/1403] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 19:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 19:57:28.461715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:28.462262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:28.462262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:28.463584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 705/1404] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:28.469117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a9006-13c6-4f2a-8246-6a0f820f8808 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:28.469519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a9006-13c6-4f2a-8246-6a0f820f8808 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:28.469690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a9006-13c6-4f2a-8246-6a0f820f8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:28.542998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-658a9006-13c6-4f2a-8246-6a0f820f8808 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:28.544721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-658a9006-13c6-4f2a-8246-6a0f820f8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:28.663033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 700/1405] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:28.710963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:28.712697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:28.819230 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:28.887101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62687a-cda8-49f9-9063-dec727fe25b4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:29.088174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:29.089104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:29.089685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:29.090142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:29.093924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:29.168100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:29.206724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:29.208383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390f3fc-659c-4852-ba72-f3715d816b9d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:29.228007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 706/1406] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:31.416379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:31.416949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:31.416949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:31.424583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00c3a6-a6df-4ace-bf49-1032c718baf5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:31.425112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00c3a6-a6df-4ace-bf49-1032c718baf5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:31.425112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00c3a6-a6df-4ace-bf49-1032c718baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:31.429835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 701/1407] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:57:31 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:31.505953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1e00c3a6-a6df-4ace-bf49-1032c718baf5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:31.507079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1e00c3a6-a6df-4ace-bf49-1032c718baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:31.624331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 707/1408] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:57:31.674504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:31.676049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:31.762629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:31.847216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaad323-f9c8-497b-8d43-edb8b1a3cc39 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:31.984705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:31.985338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:31.985608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:31.985884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:31.987529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:32.028988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:32.090065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:32.092710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dec19f-339a-4a8c-942d-1d79519efb6c service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:32.113502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 702/1409] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:41.623101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:42.109961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=30 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:49.661636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a9e0-8970-463d-9395-b889d65f5c29 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:49.662213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a9e0-8970-463d-9395-b889d65f5c29 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:49.662213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a9e0-8970-463d-9395-b889d65f5c29 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:49.663544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 708/1410] 10.222.0.95 () {54 vars in 918 bytes} [Fri Aug 5 19:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:49.669242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb0cf-f7d0-4ba4-85af-5c54115798a2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:49.670439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb0cf-f7d0-4ba4-85af-5c54115798a2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:49.670439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb0cf-f7d0-4ba4-85af-5c54115798a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:49.774052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-524fb0cf-f7d0-4ba4-85af-5c54115798a2 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:49.775203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-524fb0cf-f7d0-4ba4-85af-5c54115798a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:49.926465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 703/1411] 10.222.0.95 () {58 vars in 1015 bytes} [Fri Aug 5 19:57:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:49.945336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3ee0-9e9e-4758-852b-2a22774b2a95 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:49.945615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3ee0-9e9e-4758-852b-2a22774b2a95 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:49.945890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f3ee0-9e9e-4758-852b-2a22774b2a95 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:49.947257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 709/1412] 10.222.0.95 () {54 vars in 918 bytes} [Fri Aug 5 19:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:49.954028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb45d8-2823-4f75-9ff6-d2706227b5f1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:49.954298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb45d8-2823-4f75-9ff6-d2706227b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:49.954577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb45d8-2823-4f75-9ff6-d2706227b5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:50.033426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:50.037744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e5eb45d8-2823-4f75-9ff6-d2706227b5f1 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:50.039623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e5eb45d8-2823-4f75-9ff6-d2706227b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:50.334335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 704/1413] 10.222.0.95 () {58 vars in 1015 bytes} [Fri Aug 5 19:57:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:52.829308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:52.829846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:52.829846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:52.831135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:52.836547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982f9a-a3fc-4e6f-8d89-d71a2504faa0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:52.836981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982f9a-a3fc-4e6f-8d89-d71a2504faa0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:52.837093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982f9a-a3fc-4e6f-8d89-d71a2504faa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:52.908331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ad982f9a-a3fc-4e6f-8d89-d71a2504faa0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:52.909538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad982f9a-a3fc-4e6f-8d89-d71a2504faa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:52.970114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:53.012172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:53.054887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:53.056480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:53.205020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bd76a-2575-45ff-bc18-03582f2f83e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:53.276804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:53.318012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:53.318620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:53.318892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:53.319157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:53.320778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:53.408389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:53.410138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ff0ec-960a-443c-9736-4ae49145ffed service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:53.428888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 711/1416] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:54.347679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:54.348280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:54.348280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:54.349660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:54.354611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ddac-4a0d-4081-bc90-a4155670ebec None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:54.355024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ddac-4a0d-4081-bc90-a4155670ebec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:54.355151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ddac-4a0d-4081-bc90-a4155670ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:54.434326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6ae0ddac-4a0d-4081-bc90-a4155670ebec None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:54.436130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6ae0ddac-4a0d-4081-bc90-a4155670ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:54.462792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:54.537055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:54.692775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:54.694303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:54.837221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349748f-2f5e-44dc-8a5b-112d63d19bac None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:54.876772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:54.956021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:54.956689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:54.956962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:54.957222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:54.958798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:55.045269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:55.046778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143fb2-d96d-4351-b105-97fbc9386100 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:55.064799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 707/1419] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:55.960421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:55.961008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:55.961008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:55.962494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:55.968569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c32cc-7a05-4a65-80f0-58e92de28c5d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:55.969015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c32cc-7a05-4a65-80f0-58e92de28c5d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:55.969120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c32cc-7a05-4a65-80f0-58e92de28c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:56.022840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:56.046060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ea6c32cc-7a05-4a65-80f0-58e92de28c5d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:56.047499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea6c32cc-7a05-4a65-80f0-58e92de28c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:56.141767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:56.304564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:56.307965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:56.451671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfba73f-4782-4615-aeb2-ca32134f9307 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:56.463690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:56.568751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:56.569290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:56.569567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:56.569835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:56.571463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:56.668880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:56.671436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64dc6f-9800-43e8-92c2-8f85a5065e77 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:56.691049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 714/1422] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:57.570508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:57.571260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:57.571260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:57.572431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:57.577623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e701d3-792e-4baf-a679-cae1dbcd6220 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:57.578052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e701d3-792e-4baf-a679-cae1dbcd6220 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:57.578157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e701d3-792e-4baf-a679-cae1dbcd6220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:57.598051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:57.653820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b2e701d3-792e-4baf-a679-cae1dbcd6220 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:57.655720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b2e701d3-792e-4baf-a679-cae1dbcd6220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:57.754237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:57.911068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:57.912601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:58.020788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:58.057572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ab117-e857-4c61-b6e8-819813373ecb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:58.173210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:58.173821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:58.174097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:58.174393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:58.176039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:58.252427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:58.267194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:58.268811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702884b-a618-4b79-936e-1309aab294aa service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:58.291322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 710/1425] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:59.157819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:59.158366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:59.158366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:59.159923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:57:59.165091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b6a-1930-4441-b55e-5ac0fbf78de9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:59.165526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b6a-1930-4441-b55e-5ac0fbf78de9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:59.165664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b6a-1930-4441-b55e-5ac0fbf78de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:59.241326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e57c2b6a-1930-4441-b55e-5ac0fbf78de9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:57:59.242534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e57c2b6a-1930-4441-b55e-5ac0fbf78de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:59.337886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:57:59.488653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:57:59.490191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:59.574379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:59.637692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932119-976e-4d79-bb4f-ab8733d2de43 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:57:59.752026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:57:59.752542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:57:59.752842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:57:59.753114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:57:59.754718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:57:59.802192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:59.844700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:57:59.846286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d665-c32d-4c9b-a493-d9fe227ce87d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:57:59.864009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 717/1428] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:00.678649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:00.679214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:00.679214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:00.680608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:00.685558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedd459-e93c-4e61-88a8-4ede4beecbbd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:00.685993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedd459-e93c-4e61-88a8-4ede4beecbbd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:00.686103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedd459-e93c-4e61-88a8-4ede4beecbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:00.764559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3eedd459-e93c-4e61-88a8-4ede4beecbbd None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:00.765751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3eedd459-e93c-4e61-88a8-4ede4beecbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:00.983557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:01.133738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:01.135260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:01.184295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:01.287945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3867dc-8175-45e1-bdee-57c047ad02de None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:01.401863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:01.402478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:01.402752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:01.403020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:01.404669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:01.411537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:01.494042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:01.495709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589ec8-4d45-4292-97bc-830cf4924f21 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:01.514588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 713/1431] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:02.327521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:02.328156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:02.328156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:02.329459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:02.334522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d849f-682d-499b-a252-c51cbbc2a82b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:02.334947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d849f-682d-499b-a252-c51cbbc2a82b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:02.335186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d849f-682d-499b-a252-c51cbbc2a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:02.411836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-200d849f-682d-499b-a252-c51cbbc2a82b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:02.413101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-200d849f-682d-499b-a252-c51cbbc2a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:02.489553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:02.523974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:58:02.682855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:02.684405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:02.702773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:02.835397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479322db-6773-44ee-b81f-a486b4ca116d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:02.921300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:02.948513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:02.949130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:02.949404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:02.949674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:02.951437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:03.040041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:03.041606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3a0a1-c84e-4230-b90f-1ec19087191f service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:03.060307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 720/1434] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:03.870427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:03.870955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:03.870955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:03.872299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:03.877414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca942-9ed4-4945-a730-907ae491d5fb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:03.877813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca942-9ed4-4945-a730-907ae491d5fb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:03.877962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca942-9ed4-4945-a730-907ae491d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:03.955433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4aeca942-9ed4-4945-a730-907ae491d5fb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:03.959423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4aeca942-9ed4-4945-a730-907ae491d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:04.000126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:04.055936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:04.208057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:04.209566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:04.354087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9381-00c9-465c-ab43-b0b4109c821a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:04.419887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:04.480643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:04.481164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:04.481438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:04.481703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:04.483332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:04.572700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:04.574271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f14fe-f747-4c3a-ab53-068efe2be5b7 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:04.592204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 716/1437] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:05.407099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:05.407642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:05.407642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:05.409044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 19:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:05.414019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76869-6309-4e34-bd58-2c6adc46df1b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:05.414448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76869-6309-4e34-bd58-2c6adc46df1b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:05.414554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76869-6309-4e34-bd58-2c6adc46df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:05.494911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-89d76869-6309-4e34-bd58-2c6adc46df1b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:05.496312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89d76869-6309-4e34-bd58-2c6adc46df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:05.499096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:05.593558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:05.752182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:05.753692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:05.899396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aba88-c13d-43fa-a522-07b33c3a8f95 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:05.926331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:06.016201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:06.016726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:06.016994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:06.017257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:06.018855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:06.112732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:06.114426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdeec9-6b86-45c1-a949-6a8f5c85ef1e service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:06.132236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 723/1440] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:08.073781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:08.074307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:08.074307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:08.075752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:08.081561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdedbd-cd46-472c-976d-e7432b0becbd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:08.081986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdedbd-cd46-472c-976d-e7432b0becbd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:08.082104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdedbd-cd46-472c-976d-e7432b0becbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:08.121970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:08.148484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a4cdedbd-cd46-472c-976d-e7432b0becbd None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:08.149675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a4cdedbd-cd46-472c-976d-e7432b0becbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:08.257590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:08.296716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:08.298521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:08.401704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2fa0-7ad4-4ae4-8cb4-4f78f7afbfb1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:08.434533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:08.486820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:08.487439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:08.487715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:08.488015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:08.489645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:08.599893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:08.601333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b2ec-890e-4cf0-9b27-6ac0728b2e69 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:08.619800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 719/1443] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:10.792781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:10.793302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:10.793302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:10.795158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:10.800821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267d6a-a943-438a-b661-79a76241f553 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:10.801267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267d6a-a943-438a-b661-79a76241f553 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:10.801372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267d6a-a943-438a-b661-79a76241f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:10.865978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-03267d6a-a943-438a-b661-79a76241f553 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:10.867163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-03267d6a-a943-438a-b661-79a76241f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:10.880446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:10.966344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:11.005939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:11.007427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:11.108819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb209b-4119-4edb-91f0-642afbd120eb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:11.120516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:11.182328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:11.182931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:11.183200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:11.183463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:11.185088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:11.298221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:11.299638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3677-5a03-4911-ac01-7159b22bce42 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:11.318998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 726/1446] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:13.744570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:13.745132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:13.745132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:13.746378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:13.751670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ab7f-29f5-44d1-a381-9c5769bc0423 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:13.752144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ab7f-29f5-44d1-a381-9c5769bc0423 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:13.752242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ab7f-29f5-44d1-a381-9c5769bc0423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:13.801332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:13.819658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1706ab7f-29f5-44d1-a381-9c5769bc0423 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:13.820883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1706ab7f-29f5-44d1-a381-9c5769bc0423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:13.915736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:13.956069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:13.957580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:14.059844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bd67f-e68b-49ca-b13d-f38a4d1d208f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:14.101388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:14.136255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:14.136865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:14.137137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:14.137405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:14.139635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:14.248952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:14.250381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfabe-2344-46ad-94a1-3c3b2361c68b service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:14.268184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 722/1449] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:16.395555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:16.396153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:16.396153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:16.397455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:16.402602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d751b-c5a7-4e09-aadd-083a0f119071 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:16.403020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d751b-c5a7-4e09-aadd-083a0f119071 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:16.403182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d751b-c5a7-4e09-aadd-083a0f119071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:16.471217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bb9d751b-c5a7-4e09-aadd-083a0f119071 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:16.472443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bb9d751b-c5a7-4e09-aadd-083a0f119071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:16.493313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:16.577548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:16.616237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:16.617753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:16.720237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c6e6-e82f-4772-9598-5da1d0ff5944 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:16.739349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:16.792964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:16.793573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:16.793847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:16.794121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:16.795758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:16.903333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:16.905491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7462e0-9864-4543-8196-f15c35c3d034 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:16.923770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 729/1452] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:19.052286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:19.052852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:19.052852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:19.054155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:19.059410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0ef2-c6d4-4f70-9f10-c1edc5d81ec1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:19.059863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0ef2-c6d4-4f70-9f10-c1edc5d81ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:19.059960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0ef2-c6d4-4f70-9f10-c1edc5d81ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:19.122908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:19.126748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-743a0ef2-c6d4-4f70-9f10-c1edc5d81ec1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:19.128501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-743a0ef2-c6d4-4f70-9f10-c1edc5d81ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:19.227292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:58:19.265567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:19.267093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:19.374321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0468e-c854-42ac-8415-610592a0e8fb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:19.426333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:19.449494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:19.450109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:19.450389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:19.450659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:19.452719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:19.564414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:19.565836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc8ec-dbe7-46a8-a455-8049ae695d42 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:19.584271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 725/1455] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:21.730395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:21.730938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:21.730938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:21.732402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:21.738503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ccb2-983a-4ef8-9406-e3e2954942f9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:21.739231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ccb2-983a-4ef8-9406-e3e2954942f9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:21.739231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ccb2-983a-4ef8-9406-e3e2954942f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:21.807853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6bb5ccb2-983a-4ef8-9406-e3e2954942f9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:21.809073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6bb5ccb2-983a-4ef8-9406-e3e2954942f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:21.840032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:21.909897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:21.948954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:21.950478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:22.059449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019741b4-d2da-4271-a9c4-bf7d125c88df None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:22.088651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:22.136886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:22.137507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:22.137796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:22.138042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:22.140446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:22.253069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:22.254556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e16f23-107d-47c1-ad97-d7ae62545dee service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:22.274833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 732/1458] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:24.338367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:24.338953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:24.338953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:24.340302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:24.346306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a346-8bfd-48b5-b058-897d7bd9a017 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:24.346748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a346-8bfd-48b5-b058-897d7bd9a017 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:24.346860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a346-8bfd-48b5-b058-897d7bd9a017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:24.412174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8bf5a346-8bfd-48b5-b058-897d7bd9a017 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:24.413361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8bf5a346-8bfd-48b5-b058-897d7bd9a017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:24.422000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:24.512577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:58:24.553024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:24.556018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:24.665635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ff03-3a23-42fb-b50d-1c8ae51e1a75 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:24.726564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:24.746135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:24.746787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:24.747032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:24.747301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:24.749363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:24.863320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:24.864700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb5d34-bdd9-4573-85ab-8bf1b7032808 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:24.883455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 728/1461] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:27.013408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:27.013971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:27.013971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:27.015287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:27.020716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819023f4-da34-4dbe-8168-9b1d3acabb76 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:27.021110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819023f4-da34-4dbe-8168-9b1d3acabb76 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:27.021266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819023f4-da34-4dbe-8168-9b1d3acabb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:27.089035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-819023f4-da34-4dbe-8168-9b1d3acabb76 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:27.090232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-819023f4-da34-4dbe-8168-9b1d3acabb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:27.132573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:27.192605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:27.230623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:27.232715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:27.336158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c144b-6371-4b4e-8760-c9aeb0bfec5e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:27.373223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:27.414750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:27.415369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:27.415637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:27.415972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:27.417790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:27.541414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:27.542828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7c49-9161-430b-8b74-983bfb6df889 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:27.562178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 735/1464] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:29.629229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:29.629809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:29.629809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:29.631117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:29.636613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73b21-5c85-4dc8-8fb5-31510e7daad3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:29.637041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73b21-5c85-4dc8-8fb5-31510e7daad3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:29.637159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73b21-5c85-4dc8-8fb5-31510e7daad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:29.704445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0ec73b21-5c85-4dc8-8fb5-31510e7daad3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:29.705553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ec73b21-5c85-4dc8-8fb5-31510e7daad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:29.723171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:29.804790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:29.842270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:29.843801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:29.950150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649bdda-fea2-46a4-ae89-4a0a38b15461 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:30.017413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:30.024410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:30.025029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:30.025304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:30.025572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:30.027175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:30.136897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:30.138852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8952-8033-46a3-9393-f185a5d0a973 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:30.158794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 731/1467] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:32.199898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:32.200496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:32.200496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:32.202862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 19:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:32.208256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a445b-4c2b-483b-9b57-6d44efa75663 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:32.208686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a445b-4c2b-483b-9b57-6d44efa75663 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:32.208816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a445b-4c2b-483b-9b57-6d44efa75663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:32.274609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-655a445b-4c2b-483b-9b57-6d44efa75663 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:32.275831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-655a445b-4c2b-483b-9b57-6d44efa75663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:32.324948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:32.376482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:32.413457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:32.414978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:32.520090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0476b-1846-47b4-9179-07afc5a6a8c0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:32.567629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:32.594825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:32.595439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:32.595715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:32.596097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:32.597725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:32.711572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:32.713019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733164d-6cc0-4454-bf97-342ac8587aeb service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:32.731267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 738/1470] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:42.374660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=22 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:42.729078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=66 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:52.678790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545bff7-d41a-4499-b6ba-89143b3f91cb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:52.679321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545bff7-d41a-4499-b6ba-89143b3f91cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:52.679321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545bff7-d41a-4499-b6ba-89143b3f91cb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:52.680782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 733/1471] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:52.686697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ea42-4dee-476c-987c-8866da6a0a44 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:52.687131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ea42-4dee-476c-987c-8866da6a0a44 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:52.687246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ea42-4dee-476c-987c-8866da6a0a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:52.755000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4d11ea42-4dee-476c-987c-8866da6a0a44 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:52.756227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d11ea42-4dee-476c-987c-8866da6a0a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:52.851666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 739/1472] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:52.939033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:52.939308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:52.939592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:52.940953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 734/1473] 10.222.0.95 () {54 vars in 966 bytes} [Fri Aug 5 19:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:52.945648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c4cc-67a1-42c6-b55b-263a459ae69a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:52.945937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c4cc-67a1-42c6-b55b-263a459ae69a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:52.946215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c4cc-67a1-42c6-b55b-263a459ae69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:53.031611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6fa0c4cc-67a1-42c6-b55b-263a459ae69a None None] MFA Rules not processed for user `a3e8c4b63db4457aab286cf3f228dd26`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:53.032859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6fa0c4cc-67a1-42c6-b55b-263a459ae69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:53.053419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:53.109543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 740/1474] 10.222.0.95 () {58 vars in 1063 bytes} [Fri Aug 5 19:58:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:53.117016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:53.118498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:53.227547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791a8e-b9cc-446c-9a1b-9820ae8c4232 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:53.303631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:53.304299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:53.304647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:53.304916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:53.306685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:53.363604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:53.417684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:53.419692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5987f1-cf99-4ee6-a342-bd621bdeb173 service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:53.440435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 735/1475] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:58:55.562069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:55.562628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:55.562628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:55.564019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 741/1476] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:55.569338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b165-d8b0-4e1f-853c-471ad3b67849 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:55.569763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b165-d8b0-4e1f-853c-471ad3b67849 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:55.569872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b165-d8b0-4e1f-853c-471ad3b67849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:55.634252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2b51b165-d8b0-4e1f-853c-471ad3b67849 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:55.635455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2b51b165-d8b0-4e1f-853c-471ad3b67849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:55.731718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 736/1477] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:58:55.754469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:55.756042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:55.880028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4974311-964c-4f92-a784-3d619b10e003 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:55.928805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:55.975121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:55.975733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:55.976037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:55.976304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:55.976995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:55.978714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:58:55.978714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 19:58:55.978714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 19:58:55.979867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a5c3-f131-45a5-867b-75da83bd9afb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:55.998751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 742/1478] 10.222.0.95 () {56 vars in 1108 bytes} [Fri Aug 5 19:58:55 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 19:58:58.079323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:58.079895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:58.080013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:58.081314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 737/1479] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:58:58.086569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5759-bb04-4c04-9ee7-d986005b48be None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:58.086986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5759-bb04-4c04-9ee7-d986005b48be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:58.087120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5759-bb04-4c04-9ee7-d986005b48be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:58.152585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-eaed5759-bb04-4c04-9ee7-d986005b48be None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:58:58.154930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eaed5759-bb04-4c04-9ee7-d986005b48be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:58.254687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 743/1480] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:58:58.299454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:58:58.301011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:58.311410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:58.451562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db7eba-c96d-4249-8f42-123c72da9ff9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:58:58.534528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:58.567721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:58:58.568365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:58:58.568665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:58:58.568933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:58:58.570529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:58:58.658933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:58:58.660534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353984d1-ab43-4a42-bee5-96a55e935f32 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:58:58.679567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 738/1481] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:59:00.951236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:00.951808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:00.951808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:00.953162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 744/1482] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:59:00.958322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eab9c-93cd-4445-af1d-1bcdc65fd142 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:00.958769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eab9c-93cd-4445-af1d-1bcdc65fd142 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:00.958876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eab9c-93cd-4445-af1d-1bcdc65fd142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:01.028749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c79eab9c-93cd-4445-af1d-1bcdc65fd142 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:59:01.029945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c79eab9c-93cd-4445-af1d-1bcdc65fd142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:01.077633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:01.135369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 739/1483] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:59:01.175182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:59:01.176749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:01.200635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:01.289857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc404-8a0b-4d74-bba6-ca43e390cd8e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:59:01.364776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:59:01.365392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:01.365665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:01.365933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:01.367571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:01.443576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:01.478815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:59:01.480207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28658e03-01e4-4ac2-9e85-3ef40cb006c0 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:59:01.500387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 745/1484] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:59:03.568568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:03.569145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:03.569260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:03.570559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 740/1485] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:59:03.575923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afe9-2a76-4ef8-90a8-566030b86ded None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:03.576337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afe9-2a76-4ef8-90a8-566030b86ded None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:03.576489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afe9-2a76-4ef8-90a8-566030b86ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:03.642468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d445afe9-2a76-4ef8-90a8-566030b86ded None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:59:03.643671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d445afe9-2a76-4ef8-90a8-566030b86ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:03.742379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 746/1486] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:59:03.781549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:59:03.783090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:03.888467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cefbd-1a2c-420f-8901-a59a1ec34183 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:59:03.960168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:03.962350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:59:03.962973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:03.963443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:03.963770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:03.965731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:04.074400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:59:04.075727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea341d-29ae-4849-b298-36a55afeff8c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:59:04.093593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 741/1487] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:59:06.210558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:06.211057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:06.211160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:06.212514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 747/1488] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:59:06.217719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52dab8-2c1b-4265-9aa5-851959da5fec None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:06.218397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52dab8-2c1b-4265-9aa5-851959da5fec None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:06.218397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52dab8-2c1b-4265-9aa5-851959da5fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:06.286939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3f52dab8-2c1b-4265-9aa5-851959da5fec None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:59:06.288203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3f52dab8-2c1b-4265-9aa5-851959da5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:06.340762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:06.384995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 742/1489] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 19:59:06.426920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:59:06.428707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:06.463650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:06.531873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d178f3-3f85-45bf-9a63-bc310ce2071a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:59:06.606573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:59:06.607182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:06.607454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:06.607717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:06.609975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:06.688887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:06.718605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:59:06.720058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad41854-0824-49d9-9b94-e4dc34e8fbb1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:59:06.738797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 748/1490] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:59:09.003581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:09.004180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:09.004180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:09.005489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 743/1491] 10.222.0.95 () {54 vars in 927 bytes} [Fri Aug 5 19:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 19:59:09.010644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420d9ce-62a2-4752-90c6-d42d676ecfb3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:09.011073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420d9ce-62a2-4752-90c6-d42d676ecfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:09.011177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420d9ce-62a2-4752-90c6-d42d676ecfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:09.079762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a420d9ce-62a2-4752-90c6-d42d676ecfb3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 19:59:09.080994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a420d9ce-62a2-4752-90c6-d42d676ecfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:09.179137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 749/1492] 10.222.0.95 () {58 vars in 1024 bytes} [Fri Aug 5 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 19:59:09.220272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 19:59:09.222389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:09.325954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8946db-e208-4b45-bdc3-6a56a2dca97e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 19:59:09.401098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 19:59:09.401707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 19:59:09.401982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 19:59:09.402252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 19:59:09.403885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 19:59:09.413204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:09.517781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 19:59:09.519220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1989f2-ee0a-4d30-b5ad-e6d162bd1f17 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 19:59:09.537582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 744/1493] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 19:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 19:59:19.177294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=82 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:59:19.535128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=50 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:20.543443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:20.544081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:20.544081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:20.625726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:00:20.626836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:20.723031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 750/1494] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:00:20.732061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:20.732637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:20.732637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:20.811482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:00:20.812729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:20.910175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 745/1495] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:00:20.914823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:20.916049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:20.928787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74eb86-bb00-41f6-8a4d-de04ec64fb58 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:20.990661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:21.024631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.025240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.025509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.025771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.026455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:00:21.026742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.028459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.028459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:00:21.028459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:00:21.029329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.040247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 751/1496] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:00:21.049209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:21.059210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48339960-d213-4610-8ee1-95b6994abd10 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:21.122532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:21.157426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.158039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.158317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.158616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.159269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.161055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.161055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:00:21.161055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:00:21.162188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.219576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 746/1497] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:00:21 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:00:21.223905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:21.225417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:21.263082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508c80-9e08-42a8-9c31-920d4ce1a1c5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:21.358297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.358910 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.359178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.359448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.360137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.361132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.361132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:00:21.361132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:00:21.362315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.404645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 752/1498] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:00:21 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:00:21.409243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:21.410758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:21.477021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2ac9-0db6-4c73-9f19-4f808f149ba3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:21.562492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:21.573477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.574116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.574388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.574764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.576789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.577801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.577801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:00:21.577801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:00:21.578690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.591677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 747/1499] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:00:21.595764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:21.597352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:21.609791 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf878eae-3809-4a90-a4ff-f800c065b5e9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:21.633939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:21.708482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.709006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.709274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.709536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.710217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.711207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.711207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:00:21.711207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:00:21.712095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44b02f-ef48-40da-876a-369e00c7ab89 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.724917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 753/1500] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:00:21.729245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:21.731624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:21.767702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fb931-cb03-4137-a76c-33cfe7121d33 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:21.863463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:21.864243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.864525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.864800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] PATH_INFO: `/v3/projects/93516d14391045beb065110061f2fbca/users/8159a8a77dd44d6189cc2ebcd963ec41/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.889124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93516d14391045beb065110061f2fbca, user_id=8159a8a77dd44d6189cc2ebcd963ec41, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:21.890156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:21.890156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:00:21.890156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:00:21.892130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e6ee2-e17e-42d0-bd93-eacdebc29c91 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:21.918926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 748/1501] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:00:21 2022] PUT /identity/v3/projects/93516d14391045beb065110061f2fbca/users/8159a8a77dd44d6189cc2ebcd963ec41/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:00:21.931650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93e0a-8478-4405-8264-47cc0af1a1ae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:21.931969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93e0a-8478-4405-8264-47cc0af1a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:21.932242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93e0a-8478-4405-8264-47cc0af1a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:21.993688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b7f93e0a-8478-4405-8264-47cc0af1a1ae None None] MFA Rules not processed for user `8159a8a77dd44d6189cc2ebcd963ec41`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:00:21.994845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b7f93e0a-8478-4405-8264-47cc0af1a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:22.076159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 754/1502] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:00:22.089523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.089798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.090067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:22.091405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 749/1503] 10.222.0.95 () {54 vars in 964 bytes} [Fri Aug 5 20:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:00:22.096760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2cab-60cc-4eb5-b14e-10abb596cea5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.097137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2cab-60cc-4eb5-b14e-10abb596cea5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.097585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2cab-60cc-4eb5-b14e-10abb596cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:22.131403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:22.177943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c08f2cab-60cc-4eb5-b14e-10abb596cea5 None None] MFA Rules not processed for user `2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:00:22.179148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c08f2cab-60cc-4eb5-b14e-10abb596cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:22.260415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 755/1504] 10.222.0.95 () {58 vars in 1061 bytes} [Fri Aug 5 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:00:22.268204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:22.269702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:22.321145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:22.378949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a52b-b0dc-46f0-9b25-085796cbff16 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:22.453961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:22.454647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.454946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.455218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:22.456976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:22.561238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:22.562585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:22.566086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:22.582873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 750/1505] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:00:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:00:22.628243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbd4bc-7e10-45d4-8679-0151c1ad738d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.628694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbd4bc-7e10-45d4-8679-0151c1ad738d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.628789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbd4bc-7e10-45d4-8679-0151c1ad738d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:22.630043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 756/1506] 10.222.0.95 () {52 vars in 830 bytes} [Fri Aug 5 20:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:00:22.633795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:22.635104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:22.737217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0a04-9ae3-474b-898f-20e1c1ebf9f2 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:22.832560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:22.833196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.833377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.833759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] PATH_INFO: `/v3/users/8159a8a77dd44d6189cc2ebcd963ec41` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:22.845990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8159a8a77dd44d6189cc2ebcd963ec41)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:22.847000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:22.847000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:00:22.847000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:00:22.848230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:22.858386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:22.915572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8159a8a77dd44d6189cc2ebcd963ec41'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:22.930813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8159a8a77dd44d6189cc2ebcd963ec41'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:22.931264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8159a8a77dd44d6189cc2ebcd963ec41'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:22.953526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8159a8a77dd44d6189cc2ebcd963ec41'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:22.962657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8159a8a77dd44d6189cc2ebcd963ec41'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:22.969347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 751/1507] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:00:22 2022] DELETE /identity/v3/users/8159a8a77dd44d6189cc2ebcd963ec41 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:00:22.973896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:22.974199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:22.974473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:23.034169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:00:23.035357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:23.113562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:23.126919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 757/1508] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:00:23.136641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:23.137952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:23.238470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926bfe-45c0-4331-8d2f-391282101897 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:23.292014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:23.312281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:23.312905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:23.313181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:23.313452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:23.315067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:23.425548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:23.426985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c050f4e-ea79-4f70-bebc-a9aac2e11b46 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:23.445340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 752/1509] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:00:23.804753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:00:23.806001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:00:23.819406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd943e7-d424-4143-b580-c1f75d275ca1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:00:23.923093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:00:23.923728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:00:23.924028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:00:23.924293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] PATH_INFO: `/v3/projects/93516d14391045beb065110061f2fbca` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:00:23.934460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93516d14391045beb065110061f2fbca)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:00:23.935414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:23.935414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:00:23.935414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:00:23.936622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:00:23.996235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93516d14391045beb065110061f2fbca', 'request_id': 'req-442f3311-0b28-4f64-9114-90e612162535'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:24.009119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93516d14391045beb065110061f2fbca', 'request_id': 'req-442f3311-0b28-4f64-9114-90e612162535'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:24.015701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93516d14391045beb065110061f2fbca', 'request_id': 'req-442f3311-0b28-4f64-9114-90e612162535'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:24.043078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] The token cache is being invalidate because project 93516d14391045beb065110061f2fbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:00:24.043364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:24.043923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-442f3311-0b28-4f64-9114-90e612162535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:00:24.045525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 758/1510] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:00:23 2022] DELETE /identity/v3/projects/93516d14391045beb065110061f2fbca => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:00:33.443187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=62 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:34.040890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:06.129289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:06.129938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:06.129938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:06.131227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:06.136144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287cbe-a87d-43e7-8955-e20e62e84daa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:06.136581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287cbe-a87d-43e7-8955-e20e62e84daa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:06.136769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e287cbe-a87d-43e7-8955-e20e62e84daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:06.222538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4e287cbe-a87d-43e7-8955-e20e62e84daa None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:06.223808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4e287cbe-a87d-43e7-8955-e20e62e84daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:06.346061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:06.506811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:06.508985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:06.632311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196b804-483c-4eeb-8e50-88414ff55bd5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:06.637837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:06.638457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:06.638739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:06.639011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:06.647311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:06.649013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450def4-f9d8-4e0f-a86e-6485b9362a15 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:06.658586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 754/1513] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:07.495347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017c2d-5000-4d8f-9951-5045f40655c8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:07.495920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017c2d-5000-4d8f-9951-5045f40655c8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:07.495920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017c2d-5000-4d8f-9951-5045f40655c8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:07.497275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:07.502559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309df9-5568-4a54-8876-d094add0fc80 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:07.502990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309df9-5568-4a54-8876-d094add0fc80 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:07.503116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309df9-5568-4a54-8876-d094add0fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:07.523260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9d309df9-5568-4a54-8876-d094add0fc80 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:07.524494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9d309df9-5568-4a54-8876-d094add0fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:07.533064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:07.683402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017c2d-5000-4d8f-9951-5045f40655c8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:07.698134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017c2d-5000-4d8f-9951-5045f40655c8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:07.704149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:07.704746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:07.705016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:07.705279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:07.713690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:07.715262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca2f3-fc57-401c-abc4-71fdf458782d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:07.724828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 761/1516] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:08.158863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4d3d-0676-42c9-9b1b-868c8fa84149 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:08.159072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4d3d-0676-42c9-9b1b-868c8fa84149 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:08.159317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4d3d-0676-42c9-9b1b-868c8fa84149 None None] PATH_INFO: `/v3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:08.160645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 756/1517] 10.222.0.97 () {54 vars in 925 bytes} [Fri Aug 5 20:02:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:02:08.167620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1a08-d885-4939-8c2e-17953dbb0c1b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:08.167929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1a08-d885-4939-8c2e-17953dbb0c1b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:08.168206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1a08-d885-4939-8c2e-17953dbb0c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:08.226940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-571f1a08-d885-4939-8c2e-17953dbb0c1b None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:08.228180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-571f1a08-d885-4939-8c2e-17953dbb0c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:08.245505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:08.300623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 762/1518] 10.222.0.97 () {58 vars in 1015 bytes} [Fri Aug 5 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:17.518514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=56 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:18.297697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=23 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:18.652453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d16e1c-2867-4251-b391-f44791d7aec0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:18.652973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d16e1c-2867-4251-b391-f44791d7aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:18.652973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d16e1c-2867-4251-b391-f44791d7aec0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:18.654568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 757/1519] 10.222.0.95 () {54 vars in 961 bytes} [Fri Aug 5 20:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:18.660096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbdc7-19f4-4e7d-b0f8-f7c43dd592d2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:18.660456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbdc7-19f4-4e7d-b0f8-f7c43dd592d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:18.660792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbdc7-19f4-4e7d-b0f8-f7c43dd592d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:18.681040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f81cbdc7-19f4-4e7d-b0f8-f7c43dd592d2 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:18.682235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f81cbdc7-19f4-4e7d-b0f8-f7c43dd592d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:18.691601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 763/1520] 10.222.0.95 () {58 vars in 1058 bytes} [Fri Aug 5 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:18.699194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d16e1c-2867-4251-b391-f44791d7aec0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:18.712663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d16e1c-2867-4251-b391-f44791d7aec0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:18.717641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:18.718250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:18.718523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:18.718794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:18.727412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:18.729137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d62e31-d613-4d63-95fd-d89d49f37203 service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:18.739477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 758/1521] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:18.957695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c6bd-e010-42fc-a2e4-c6a534928f4b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:18.958057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c6bd-e010-42fc-a2e4-c6a534928f4b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:18.958341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c6bd-e010-42fc-a2e4-c6a534928f4b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:18.959835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:18.964854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba4c8-7547-424c-b29c-afab54540c40 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:18.965204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba4c8-7547-424c-b29c-afab54540c40 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:18.965542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba4c8-7547-424c-b29c-afab54540c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:18.985613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b01ba4c8-7547-424c-b29c-afab54540c40 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:18.986790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b01ba4c8-7547-424c-b29c-afab54540c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:18.994551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:02:19.158797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215c6bd-e010-42fc-a2e4-c6a534928f4b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:19.178990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215c6bd-e010-42fc-a2e4-c6a534928f4b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:19.185205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:19.186087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:19.186402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:19.186703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:19.195961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:19.198139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc12f3-83d6-4369-9621-41beab958ed4 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:19.209201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 765/1524] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:20.115321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b8e0-0aad-4151-a073-50dc65cbbc89 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:20.115911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b8e0-0aad-4151-a073-50dc65cbbc89 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:20.115911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b8e0-0aad-4151-a073-50dc65cbbc89 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:20.117327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:20.122082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873e3d-68a4-4d7c-831d-6bed120063f2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:20.122505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873e3d-68a4-4d7c-831d-6bed120063f2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:20.122677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873e3d-68a4-4d7c-831d-6bed120063f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:20.142501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c9873e3d-68a4-4d7c-831d-6bed120063f2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:20.143689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c9873e3d-68a4-4d7c-831d-6bed120063f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:20.151576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:20.314918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b8e0-0aad-4151-a073-50dc65cbbc89 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:20.330034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b8e0-0aad-4151-a073-50dc65cbbc89 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:20.335310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:20.335949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:20.336226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:20.336495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:20.345233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:20.346797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c6cdf-23e8-42ac-9017-3eb0e35d8fc3 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:20.356064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 761/1527] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:24.415096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:24.415663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:24.415663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:24.417361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:24.424868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854d91f-9c2a-4279-90f4-ce6744da1901 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:24.424868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854d91f-9c2a-4279-90f4-ce6744da1901 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:24.424868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854d91f-9c2a-4279-90f4-ce6744da1901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:24.443653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8854d91f-9c2a-4279-90f4-ce6744da1901 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:24.444875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8854d91f-9c2a-4279-90f4-ce6744da1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:24.452526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:24.527079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:24.529358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:24.612092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d3d9-ac05-4608-9bb2-3e9d4deae16d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:24.616347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:24.617051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:24.617331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:24.617603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:24.627467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:24.628931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ead4dc-cede-4f19-a7ce-cc7c0391722d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:24.639034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 768/1530] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:26.696015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e188-eaa2-4436-8b9b-f7138fa63215 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:26.696614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e188-eaa2-4436-8b9b-f7138fa63215 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:26.696614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e188-eaa2-4436-8b9b-f7138fa63215 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:26.697840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:26.703228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bce8-641a-42bf-a06a-e9eeb71bf39b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:26.703678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bce8-641a-42bf-a06a-e9eeb71bf39b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:26.703822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bce8-641a-42bf-a06a-e9eeb71bf39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:26.723639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f850bce8-641a-42bf-a06a-e9eeb71bf39b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:26.724856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f850bce8-641a-42bf-a06a-e9eeb71bf39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:26.733282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:26.769590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e188-eaa2-4436-8b9b-f7138fa63215 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:26.785485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e188-eaa2-4436-8b9b-f7138fa63215 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:26.789391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:26.789998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:26.790271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:26.790540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:26.801343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:26.802756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbdeed-ead7-4c34-a20e-65a3dfa7736c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:26.812358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 764/1533] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:30.564290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:30.564861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:30.564861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:30.566171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:30.571243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9940c1-f63f-42e4-a772-f13e2eecd3f7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:30.571696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9940c1-f63f-42e4-a772-f13e2eecd3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:30.571821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9940c1-f63f-42e4-a772-f13e2eecd3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:30.592082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cc9940c1-f63f-42e4-a772-f13e2eecd3f7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:30.593270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cc9940c1-f63f-42e4-a772-f13e2eecd3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:30.601007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:30.913026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:30.914950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:30.993787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62453f8f-3a92-46f8-9c3f-bfee49b548a2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:30.997519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:30.998124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:30.998403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:30.998670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:31.008052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:31.009463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7ab84-5cab-49ba-b42b-1e96e8fd4a73 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:31.018929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 771/1536] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:33.079578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:33.080208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:33.080208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:33.081526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:02:33.086727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825420b5-e0b4-44df-8d83-4f338986e42c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:33.087162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825420b5-e0b4-44df-8d83-4f338986e42c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:33.087280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825420b5-e0b4-44df-8d83-4f338986e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:33.107125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-825420b5-e0b4-44df-8d83-4f338986e42c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:02:33.108443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-825420b5-e0b4-44df-8d83-4f338986e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:33.116204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:02:33.424630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:02:33.426281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:02:33.439967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344879-b754-45a9-a85e-27676c3042c5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:02:33.443385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:02:33.444029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:02:33.444436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:02:33.444904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:02:33.454600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:02:33.456026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663f385-126f-4607-bed1-64249a0a7dbf service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:02:33.465274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 767/1539] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:02:43.102494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:43.461273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=33 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:01.472094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.473379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.473855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.500391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.501895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.512964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 773/1540] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:01.522217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.522817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.522817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.552004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.553221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.569432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 768/1541] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:01.574557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:01.587608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f71d04-e130-4826-81c0-5b827d1511ab None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:01.597956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:01.599225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.599742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.600260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.601195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:01.601719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:01.603679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0be9c0-cea2-470b-abca-3a5dde6c2b83 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:01.621326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 774/1542] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:01.630449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:01.644414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a231e-9fda-4938-931b-c134b5fe16a0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:01.652471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:01.653168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.653449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.653725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.654416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:01.656464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:01.717153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864113b4-1686-472a-96ab-a2a055bd3641 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.717848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864113b4-1686-472a-96ab-a2a055bd3641 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.718407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864113b4-1686-472a-96ab-a2a055bd3641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.725272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 769/1543] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:01.729592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:01.752570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-864113b4-1686-472a-96ab-a2a055bd3641 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.754841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-864113b4-1686-472a-96ab-a2a055bd3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.850810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07dc55-5295-420c-826d-be928083ffae admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:01.858574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 775/1544] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:01.860510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f53e3-f6be-447c-96ff-208828719f11 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.861125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f53e3-f6be-447c-96ff-208828719f11 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.861614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f53e3-f6be-447c-96ff-208828719f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.865815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:04:01.870976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:04:01.871644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f200b5c-f176-44cb-a611-14b656e0e9b6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:01.901040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fb3f53e3-f6be-447c-96ff-208828719f11 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.902917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb3f53e3-f6be-447c-96ff-208828719f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.917804 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 776/1545] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:01.919512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.920047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.920540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.923536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 770/1546] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:01.928029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:01.928333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:01.928581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:01.954125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.955936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.969630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:01.970864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:01.971673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 777/1547] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:01.973745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:01.991371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 771/1548] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:01.991854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aaaf4-7a4c-46fc-ae49-ea41ee532e00 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:01.992257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.001331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.002452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.003594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.004183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.005374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.007222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.021615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c93bb2-9a3b-49c7-9a71-7dcfed1d1490 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.027194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 778/1549] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:02.030691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.037084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.038084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.038649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.039841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.041054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.041574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.042793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:02.042793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:04:02.042793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:04:02.044118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b17b6-a469-401a-b2d8-386f49f3d20e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.054600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858139-2ad2-452e-a36d-4ed1e7a04e08 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.067191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.070262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.072151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 772/1550] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.072683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.073170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.074114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.075630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.076186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.078015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.078534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.079071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.107878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.109247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 779/1551] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.109836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.110318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.125742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595df3fa-4a3a-4564-b1e4-9028a952fd11 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.130708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 773/1552] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.132073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.141694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.142898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.144091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.144574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.145511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.147154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361f3a-31b7-4200-b346-d2ed607aaf87 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.147769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053666bf-02f4-405a-baa9-475d1fbf573c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.152000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.152777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.153055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.153322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.153988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.156206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613b088-86a0-4cbf-9783-e08c41837059 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.163160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 780/1553] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:02.164916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.165761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.166256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.189007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.190466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.199176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 781/1554] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.202569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.204015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 774/1555] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.210760 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d794-2881-4b9f-8f04-74a764552955 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.211409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d794-2881-4b9f-8f04-74a764552955 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.212155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d794-2881-4b9f-8f04-74a764552955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.214817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690fdf9-0a71-4461-972f-8f0ab2398f55 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.235792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c635d794-2881-4b9f-8f04-74a764552955 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.237175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c635d794-2881-4b9f-8f04-74a764552955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.279226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.279762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.280067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.280338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.281029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.282039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:02.282039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:04:02.282039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:04:02.283283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.296153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 775/1556] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.297422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fe5-72be-4138-aef9-b7772c4cd31e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.297698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fe5-72be-4138-aef9-b7772c4cd31e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.297962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fe5-72be-4138-aef9-b7772c4cd31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.306757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.312222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 782/1557] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.313024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.322834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fb643fe5-72be-4138-aef9-b7772c4cd31e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.324057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fb643fe5-72be-4138-aef9-b7772c4cd31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.327431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.381487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e68fb-0c0b-4429-a260-cb753c219de7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.384085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 776/1558] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.385580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.385868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.386144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.390594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.391273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.391549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.391842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] PATH_INFO: `/v3/projects/c39f340d77b141f581dce9c25ca3d30c/users/4983049d329a449785ce1182b4f4dce5/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.406301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.407402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39f340d77b141f581dce9c25ca3d30c, user_id=4983049d329a449785ce1182b4f4dce5, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.407533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.408478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:02.408478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:04:02.408478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:04:02.410504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f165-43da-4e04-b23b-d07314d9df4d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.416193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 777/1559] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.420609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.433422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 783/1560] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:02 2022] PUT /identity/v3/projects/c39f340d77b141f581dce9c25ca3d30c/users/4983049d329a449785ce1182b4f4dce5/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:02.433865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44fabc-9bee-44c4-81fa-961330535921 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.434908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79470-8c29-41f5-80ef-d5a82c2a8c50 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.435185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79470-8c29-41f5-80ef-d5a82c2a8c50 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.435552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79470-8c29-41f5-80ef-d5a82c2a8c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.455526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7ad79470-8c29-41f5-80ef-d5a82c2a8c50 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.457560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7ad79470-8c29-41f5-80ef-d5a82c2a8c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.499942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.500566 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.500840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.501110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.501761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.504364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048eb76-412f-4a32-a2c9-8f70b9f4191a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.519137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 784/1561] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.520829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.521142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.521409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.528384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 778/1562] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.529835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.530072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.530349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.545586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.546770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.550333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.551241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.554935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 785/1563] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.555685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.562925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 779/1564] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.563770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.568208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145d865-bcdf-4a0d-8ad6-1a82b9d15b37 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.573522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.574164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4041f9-3c5c-4404-ac97-94262eb20384 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.574366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.574737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.575089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.575901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.578212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5eab5e-f250-41ae-8d75-49db734c4b0b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.578917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.579518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.579825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.580104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.580793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.581174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.582724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dce9-485b-4c2a-9b2d-569ac423099e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.602714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 780/1565] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.602714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.602714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.602714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.606594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 786/1566] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.607894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.608277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.608696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.619184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.620435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.628403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 781/1567] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.629210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.637335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] MFA Rules not processed for user `4983049d329a449785ce1182b4f4dce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.638530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.641494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9b5ff-88b2-4f46-ae13-c2e4ce1833d8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.648624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.649235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.649511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.649774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.650460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.650756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.652340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.670905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 782/1568] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.670905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.676253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd9f4d-ccbd-4648-8511-53fe3559a546 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.681072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.681687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.681966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.682236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.682936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.684584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f370e0-b627-448d-bacb-28ef36a89dc0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.695685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 783/1569] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:02.697306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.697747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.698260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.710974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.715756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 787/1570] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.717296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.719014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:02.720201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:02.728946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 784/1571] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:02.729718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.730293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f411-5123-499f-aeb1-a7e4f3459a6c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.736732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.738035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.738407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.738746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.739543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.739960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.740349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201561d6-b4fb-4ab0-9708-696fb4afb5f2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.741855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.746051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.746898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.747267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.747641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.748628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.751080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.765478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 788/1572] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.765478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.770265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68b2e-67be-4697-99fe-b23973f4461d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.774884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.775986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.776261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.776531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.777222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.778798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.789928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 789/1573] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:02.793746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 785/1574] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.793746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.794592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.802584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.805912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282a5e-d9a7-4515-a830-56d0d3f5e66f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.858326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8785f-875b-4484-8d07-7524e5639e7c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.864110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.864850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.865161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.865433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.866250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.867476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.868128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.868286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.868392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.868661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.869355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.869653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.871216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.884935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 790/1575] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.886100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.896462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c29aec-ac6a-441c-86a7-9882c4d89584 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.900960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.901560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.901833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.902103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.902789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.907311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 786/1576] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:02.907469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d064-2d8e-47f1-b506-936ce3a42fbd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.907728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.922089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 791/1577] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:02.922089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ab3b-4383-4556-9625-c23bd277ee8d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.922089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ab3b-4383-4556-9625-c23bd277ee8d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.922089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ab3b-4383-4556-9625-c23bd277ee8d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.922553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 792/1578] 10.222.0.95 () {54 vars in 962 bytes} [Fri Aug 5 20:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:02.922995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ab3b-4383-4556-9625-c23bd277ee8d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.969411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f909-c081-44af-9378-0d5e27c77146 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.974486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.975097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.975371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.975636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.976354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:02.976654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.978238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:02.990434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ab3b-4383-4556-9625-c23bd277ee8d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:02.990812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 787/1579] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:02.991622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:02.995003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:02.995718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:02.996356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:02.996629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:02.997285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:02.999383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.002707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47950a41-7fe9-49b5-8bfd-e8c6d66457ab admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.010075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.011022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.011474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.011969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.013112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.015689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.031866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 788/1580] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.032856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.037064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 793/1581] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:02 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.041258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.045196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23f36-9b73-46cc-a881-e465238dfa5b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.087955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.106221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.106458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62277b-ce18-48e8-a052-33eba1cb5f2d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.106838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.107136 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.107405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.108098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.110030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.111033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.111642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.112027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.112859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.113513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.115374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.132545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 789/1582] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.136438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.145399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 794/1583] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.146338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.146556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc121e-cf9a-4a22-8ecf-129ca014eff2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.150406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.208960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.209588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.209868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.210140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.210797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.212748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35d8c3-8405-4aeb-bd16-b427b279621a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.215863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a9ca-a799-4980-9879-f19e83120620 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.220790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.223087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.223367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.224021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] PATH_INFO: `/v3/projects/4d53bf6f50b2493b86d412684ca37345/users/2dc7c2d3652843668e855c81f6a77f1b/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.234979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 790/1584] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.236602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.236890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.237179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.245096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d53bf6f50b2493b86d412684ca37345, user_id=2dc7c2d3652843668e855c81f6a77f1b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.248273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.261820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 795/1585] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:03 2022] PUT /identity/v3/projects/4d53bf6f50b2493b86d412684ca37345/users/2dc7c2d3652843668e855c81f6a77f1b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:03.262590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.279931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:03.280981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:03.326450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720bce-33ee-4fc1-8aa6-cb8ee3a6fdf9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.331173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.332115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.332398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.332670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.333418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.335326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.349521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 791/1586] 10.222.0.95 () {58 vars in 1059 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:03.352744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.364241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9481a2-0f45-4eed-93b0-a383bc4f5d5d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.365446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 796/1587] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.366250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.413250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.428651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.428808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.429048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.429324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] PATH_INFO: `/v3/projects/0520f87324854dd0a5d0c9e10caa7fda/users/edf898f67aca42db8d51924ca4d8a300/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.443401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06358-29f9-4acd-93e9-47fc9c3a57b1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.445266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0520f87324854dd0a5d0c9e10caa7fda, user_id=edf898f67aca42db8d51924ca4d8a300, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.448119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.448921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.449547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.449819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.450082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.450892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.453296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.457105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.463023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 792/1588] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:03 2022] PUT /identity/v3/projects/0520f87324854dd0a5d0c9e10caa7fda/users/edf898f67aca42db8d51924ca4d8a300/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:03.464618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.477428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 797/1589] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.481236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.491064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c998d3-9bfd-4149-9a6e-4ae051fc6fc6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.529645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c2e05-642e-46f0-a126-3697722804f8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.535169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.535922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.536227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.536480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.537282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.538874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.547440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.548102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.548379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.548651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.549311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.549442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 793/1590] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.552085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21792e0-098a-4b8f-9b2a-c03064aa4ae2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.552888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.563292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2220-4537-4c13-8905-060e15d5af0d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.569080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.569691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.569971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.570240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.570925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.572546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.577831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 798/1591] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.577831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.577831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.577831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.587094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 794/1592] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.588144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.609115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] MFA Rules not processed for user `2dc7c2d3652843668e855c81f6a77f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:03.610353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:03.659739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca89526-ea86-4570-82fd-2f8fa6b1aadb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.666941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.667726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.667857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.668119 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.677236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 799/1593] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:03.678259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.689494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfa43f-6054-4f78-83d0-e4ab3e0620bb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.695366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.696316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.696703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.697132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.697906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.700187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f843a-6511-49c3-9fe3-8668e0fe7921 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.725914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 800/1594] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.727490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.727793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.728079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.733595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.735219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.744669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 795/1595] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:03.745479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.746505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:03.747686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:03.755419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac860-409f-4765-bff1-7411a3a4e75c service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.756250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 801/1596] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:03.756816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.763438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.764085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.764408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.764683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.765371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.766932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.776548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946bbe-6123-48e2-8cb3-4564b23589e0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.779273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 796/1597] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.780144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.786373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.786994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.787271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.787581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.788412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.790140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.792109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115f5a-d30d-4c07-92d4-7b7657875c56 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.797410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.798340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.798604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.798867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.799549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.801203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.802053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 802/1598] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.802785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.808423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.814070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744d1c-724a-48e0-98f0-2d3499096f92 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.820869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.822131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.822606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.823058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.824223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.825050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 797/1599] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.825674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.826968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.837375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.840223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc0107-ddfe-40e3-8d07-2f7736ee4583 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.841185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 803/1600] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.842142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.849398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.850020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.850306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.850564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.851290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.853343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.855271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0a5-cfc1-448a-abb8-1c30aad19b4e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.861315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.862549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.863155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.863610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.864636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.867273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.880540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 804/1601] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.881771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.885442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:03.886424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 798/1602] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:03 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:03.887170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.951662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97635d-7e1f-47cc-a9f0-70d0a14093e5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.960556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec556c5-2234-49cf-b22d-da1d57056828 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:03.966758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:03.968228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:03.968683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:03.969543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:03.970390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:03.973410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:03.988008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 799/1603] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:03.988008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:03.995893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f57b-2642-4a69-9584-ce64761f2d8a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.000685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.001350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.001628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.001898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] PATH_INFO: `/v3/projects/7546ec15aa62489c87760b69b8545331/users/3225736d7a7e4e20b40b5f3166f0d648/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.007157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.007902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.008246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.008578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.017143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7546ec15aa62489c87760b69b8545331, user_id=3225736d7a7e4e20b40b5f3166f0d648, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.017834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.020062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.020371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.030363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 805/1604] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:04.030963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.033257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 800/1605] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:03 2022] PUT /identity/v3/projects/7546ec15aa62489c87760b69b8545331/users/3225736d7a7e4e20b40b5f3166f0d648/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:04.034143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.047550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64c9c-6dcd-4e96-8a7f-c4f663547965 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.110740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea038d-3bc7-4940-96dd-5b88e352d700 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.116343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.117138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.117475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.117850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] PATH_INFO: `/v3/projects/2d9f205b7bd747c7b51ff51aa328a3cc/users/083840b9867145389ebf9cb035f0aba1/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.118311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.118933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.119205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.119474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.120205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.122094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.133113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 806/1606] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:04.133963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.139866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9f205b7bd747c7b51ff51aa328a3cc, user_id=083840b9867145389ebf9cb035f0aba1, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.143341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.144571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e42d4-aae9-4687-aa10-d56bb073f9e7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.150577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.151237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.151512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.151970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.152671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.154441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b07f98-16f2-4fb4-b523-b7535f44e5e2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.159469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 801/1607] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:04 2022] PUT /identity/v3/projects/2d9f205b7bd747c7b51ff51aa328a3cc/users/083840b9867145389ebf9cb035f0aba1/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:04.164036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.169635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 807/1608] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:04.170900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300e70-7913-40eb-ad4b-09c1dd8e334e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.171259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300e70-7913-40eb-ad4b-09c1dd8e334e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.171597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300e70-7913-40eb-ad4b-09c1dd8e334e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.173246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 808/1609] 10.222.0.95 () {54 vars in 912 bytes} [Fri Aug 5 20:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:04.178919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300e70-7913-40eb-ad4b-09c1dd8e334e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.205186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.221441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.246591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67984-9615-4abe-814c-022da3be335a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.252200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.253714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.254221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.254501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.255425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.257361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300e70-7913-40eb-ad4b-09c1dd8e334e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.257893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653eb15-3f0c-470a-ab5b-e49e39bb9c51 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.262449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.263152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.263430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.263772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] PATH_INFO: `/v3/projects/ee40a4f040bd4984967cde7e4084f054/users/ff9fe36ed9004b5ca3c495e282168073/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.281263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee40a4f040bd4984967cde7e4084f054, user_id=ff9fe36ed9004b5ca3c495e282168073, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.283260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 802/1610] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:04.284002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.285522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67960b-eb83-4890-9877-d455afc17421 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.285984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67960b-eb83-4890-9877-d455afc17421 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.286522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67960b-eb83-4890-9877-d455afc17421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.306739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 809/1611] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:04 2022] PUT /identity/v3/projects/ee40a4f040bd4984967cde7e4084f054/users/ff9fe36ed9004b5ca3c495e282168073/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:04.318466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.331578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7e67960b-eb83-4890-9877-d455afc17421 None None] MFA Rules not processed for user `3225736d7a7e4e20b40b5f3166f0d648`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.333635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7e67960b-eb83-4890-9877-d455afc17421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.389379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7a1c-98c0-4d57-a163-8399f121e998 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.394505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.395359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.395602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.395997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] PATH_INFO: `/v3/projects/d32ac9325e4448fcb074538cacf8f090/users/6104be80705247d9a9b4b7c4a97e97ae/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.421661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 803/1612] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.421661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10c2ce-8abf-4f27-8957-d5f65bb73145 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.421661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10c2ce-8abf-4f27-8957-d5f65bb73145 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.421661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10c2ce-8abf-4f27-8957-d5f65bb73145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.425609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32ac9325e4448fcb074538cacf8f090, user_id=6104be80705247d9a9b4b7c4a97e97ae, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.429906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.443684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8a10c2ce-8abf-4f27-8957-d5f65bb73145 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.445953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8a10c2ce-8abf-4f27-8957-d5f65bb73145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.462103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 810/1613] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:04 2022] PUT /identity/v3/projects/d32ac9325e4448fcb074538cacf8f090/users/6104be80705247d9a9b4b7c4a97e97ae/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:04.462103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.531305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e53880-39fc-42aa-a134-7356e60ad30d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.537569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.538542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.539002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.539456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] PATH_INFO: `/v3/projects/43323ff64b8843639e0428c69d5c71c1/users/67e79817ed9e40728f92a22053a24118/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.547957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 804/1614] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.547957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9d12-0e5d-4e09-8e6f-1e94dbab439a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.547957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9d12-0e5d-4e09-8e6f-1e94dbab439a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.547957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9d12-0e5d-4e09-8e6f-1e94dbab439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.562465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43323ff64b8843639e0428c69d5c71c1, user_id=67e79817ed9e40728f92a22053a24118, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.570260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.579412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-837e9d12-0e5d-4e09-8e6f-1e94dbab439a None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.581910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-837e9d12-0e5d-4e09-8e6f-1e94dbab439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.595098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 811/1615] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:04 2022] PUT /identity/v3/projects/43323ff64b8843639e0428c69d5c71c1/users/67e79817ed9e40728f92a22053a24118/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:04.597212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.637149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.664751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.684195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8990f3-b196-4d9e-a376-c82371c59a24 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.688790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.689411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.689682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.689954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.691186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.692808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912cb2-08cf-44fd-9a2b-edbf93b14b8b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.694153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 805/1616] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.696084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6498-476b-46a9-b9ad-fec1571345d1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.696373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6498-476b-46a9-b9ad-fec1571345d1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.696648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6498-476b-46a9-b9ad-fec1571345d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.709993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 812/1617] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:04.709993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab416eb-9d66-47bc-9905-3c9796bbedf2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.709993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab416eb-9d66-47bc-9905-3c9796bbedf2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.710343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab416eb-9d66-47bc-9905-3c9796bbedf2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.711515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 813/1618] 10.222.0.95 () {54 vars in 962 bytes} [Fri Aug 5 20:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:04.712615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.712897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.713170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.740169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1a3c6498-476b-46a9-b9ad-fec1571345d1 None None] MFA Rules not processed for user `ff9fe36ed9004b5ca3c495e282168073`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.741434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1a3c6498-476b-46a9-b9ad-fec1571345d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.745123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] MFA Rules not processed for user `6104be80705247d9a9b4b7c4a97e97ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.746512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.824977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 814/1619] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.829458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.837776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 806/1620] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.839532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.842572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.842572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.865886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:04.867214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:04.877125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 807/1621] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:04.882136 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.918236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547cc8b-ffb6-472e-acd0-d40f87d51953 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.922208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.923328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.923328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.923565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.938376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.938376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:04.949941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 815/1622] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:04.950773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:04.960808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba7d-e10b-446f-943c-e028b32a1bd3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.961655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177abd-202f-496d-81cf-d562540933c3 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:04.965330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.966129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.966575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.966714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:04.967137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.967449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:04.967735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:04.968044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] PATH_INFO: `/v3/projects/1be38aa5522b43d9933bfadceaa15f98/users/25ccbe0b506f466d93630b490ef06760/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:04.989797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be38aa5522b43d9933bfadceaa15f98, user_id=25ccbe0b506f466d93630b490ef06760, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:04.992945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7419cd-78f6-4287-a7f7-bf8c2a43fd16 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.014760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 816/1623] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:04 2022] PUT /identity/v3/projects/1be38aa5522b43d9933bfadceaa15f98/users/25ccbe0b506f466d93630b490ef06760/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:05.014760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.014760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.014760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.049465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:05.051502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:05.067325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.069324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.074566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:05.088288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 808/1624] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:05.089245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.103173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505a85-3073-4435-b3af-8a4e48852979 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.108884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:05.139049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 817/1625] 10.222.0.95 () {58 vars in 1059 bytes} [Fri Aug 5 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:05.140121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.204185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.204930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.205413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.205882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.208390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.210741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.235705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85927f-d8ff-4ab4-a4b7-fad5510d9c8a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.247983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.248626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.248900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.249172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.263957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 809/1626] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:05 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:05.263957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.361053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72893bc-5730-4bad-b420-24b197ebc049 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.366046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.367948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.368235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.368701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.382692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.385378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.411997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 818/1627] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:05.414202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.447492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b6a0-b546-4d87-a410-202e6b1d6cdd service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.540792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.544529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.576699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 810/1628] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:05.579025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.623635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.625786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.626220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.626701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.630500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.636134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.683484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 819/1629] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:05.687935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.704360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:05.715008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160bfc1-ee1f-4e4a-bb35-d87a10cad67b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.728518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.730789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.730789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.730789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.734531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.739944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.766157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:05.793805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ad5e4-13e5-4d25-aa5f-b042b70fb36c service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.808053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 820/1630] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:05 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:05.808053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.812460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.813966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.814249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.814621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.838817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3986-5217-475a-88f3-033cfebaa3b3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:05.850690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:05.854491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:05.855075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:05.855549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] PATH_INFO: `/v3/projects/1be38aa5522b43d9933bfadceaa15f98/users/25ccbe0b506f466d93630b490ef06760/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:05.860171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be38aa5522b43d9933bfadceaa15f98, user_id=25ccbe0b506f466d93630b490ef06760, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.867832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.893116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 821/1631] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:05 2022] PUT /identity/v3/projects/1be38aa5522b43d9933bfadceaa15f98/users/25ccbe0b506f466d93630b490ef06760/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:05.895092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:05.991979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:05.993590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db009ea-60af-43e3-a03b-0127dce8139a service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:05.999188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de584c-f996-4297-9a76-9c7682f1c532 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:06.007204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:06.008247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.008932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.009462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.010761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:06.012898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:06.015618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 811/1632] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:06.025166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.025461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.025743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.054906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 822/1633] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:06.060349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:06.100487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe968eea-b0c4-45cb-83a2-aadce21ddb06 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:06.109650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] MFA Rules not processed for user `25ccbe0b506f466d93630b490ef06760`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:06.111546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:06.113284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:06.115284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.117018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.117329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] PATH_INFO: `/v3/projects/584d9778907b47bab18290ed8b68c947/users/5e6ccc6e45954acf8cac3a6a60219b95/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.162474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=584d9778907b47bab18290ed8b68c947, user_id=5e6ccc6e45954acf8cac3a6a60219b95, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:06.171529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:06.205896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 823/1634] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:06 2022] PUT /identity/v3/projects/584d9778907b47bab18290ed8b68c947/users/5e6ccc6e45954acf8cac3a6a60219b95/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:06.208235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:06.276334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 812/1635] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:06.291585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:06.379997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546393-ace0-4523-b312-1267f57ebd3d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:06.403080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:06.438907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338f3ae-2c2c-4cce-aa14-855c75d7fb8e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:06.451361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:06.453470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.453873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.455469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.456847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:06.462692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:06.468959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:06.471274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.471504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.472865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.495464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 824/1636] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:06.499820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:06.526321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe52a-7778-4338-81f5-f1b037a9f790 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:06.540448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:06.541575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.541857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.542132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] PATH_INFO: `/v3/projects/584d9778907b47bab18290ed8b68c947/users/5e6ccc6e45954acf8cac3a6a60219b95/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.545889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584d9778907b47bab18290ed8b68c947, user_id=5e6ccc6e45954acf8cac3a6a60219b95, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:06.548559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acce17-029b-4c1a-b7aa-5db27b8222d7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:06.563476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 825/1637] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:06 2022] PUT /identity/v3/projects/584d9778907b47bab18290ed8b68c947/users/5e6ccc6e45954acf8cac3a6a60219b95/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:06.576370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703c94-179c-4386-8d16-74148151457e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.576727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703c94-179c-4386-8d16-74148151457e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.576911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98703c94-179c-4386-8d16-74148151457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.696357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-98703c94-179c-4386-8d16-74148151457e None None] MFA Rules not processed for user `5e6ccc6e45954acf8cac3a6a60219b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:06.699137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-98703c94-179c-4386-8d16-74148151457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:06.722496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:06.724960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3f62e-24f8-4f84-aefc-9b88747bb37b service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:06.752565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 813/1638] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:06.851968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:06.901766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea9e77-4ea2-419c-bd4d-7b1bfec86409 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.902169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea9e77-4ea2-419c-bd4d-7b1bfec86409 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.902605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea9e77-4ea2-419c-bd4d-7b1bfec86409 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:06.904793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 814/1639] 10.222.0.95 () {54 vars in 912 bytes} [Fri Aug 5 20:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 20:04:06.910961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:06.911420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:06.911944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:07.005052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:07.008115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:07.016775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 826/1640] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:07.032583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98703c94-179c-4386-8d16-74148151457e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:07.160474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98703c94-179c-4386-8d16-74148151457e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:07.166160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:07.166876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:07.167218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:07.167560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:07.177601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 815/1641] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:07.178615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:07.179536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:07.181225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:07.191480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1566-0b44-4168-8681-b7fa12e86d83 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:07.197285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:07.197920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:07.198202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:07.198476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:07.206716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 827/1642] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:07.325423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:07.340682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe293c2-87fc-4e3c-8587-b125f9cde385 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:07.342931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:07.344510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:07.345179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:07.345827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:07.346091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:07.346469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:07.361989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:07.369306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 816/1643] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:07.397625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:07.400227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db990de-a304-4d31-a287-6fba003e87c5 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:07.458980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 828/1644] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:07.771318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:07.873185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c155a-fa5b-40fc-9962-303a53ede555 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:07.877862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:07.879049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:07.879339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:07.879603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] PATH_INFO: `/v3/users/3225736d7a7e4e20b40b5f3166f0d648` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:07.881051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3225736d7a7e4e20b40b5f3166f0d648)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:07.883184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:08.005029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3225736d7a7e4e20b40b5f3166f0d648'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:08.023005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3225736d7a7e4e20b40b5f3166f0d648'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:08.023768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3225736d7a7e4e20b40b5f3166f0d648'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:08.058425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3225736d7a7e4e20b40b5f3166f0d648'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:08.075367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3225736d7a7e4e20b40b5f3166f0d648'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:08.091468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 817/1645] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:07 2022] DELETE /identity/v3/users/3225736d7a7e4e20b40b5f3166f0d648 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:08.096724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:08.098224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:08.098719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:08.166866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:08.176714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:08.340106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 829/1646] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:08.344402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:08.345883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:08.483973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce44453-ee83-49e3-8c54-2586f26d9e97 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:08.488921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:08.489626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:08.489907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:08.490293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:08.523977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:08.525970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baf908-20bd-413e-92be-cce6b60ed1a1 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:08.544238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 818/1647] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:08.885552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:08.887016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:08.900846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c959f5b-9a89-47cf-9b1d-71f033209ed3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:08.905764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:08.906589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:08.907023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:08.907430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] PATH_INFO: `/v3/users/6104be80705247d9a9b4b7c4a97e97ae` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:08.909010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6104be80705247d9a9b4b7c4a97e97ae)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:08.910987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: WARNING py.warnings [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:08.910987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: warnings.warn(msg) Aug 05 20:04:08.910987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: Aug 05 20:04:08.912557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:09.026055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:09.031869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6104be80705247d9a9b4b7c4a97e97ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.033172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6104be80705247d9a9b4b7c4a97e97ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.073960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6104be80705247d9a9b4b7c4a97e97ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.088672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6104be80705247d9a9b4b7c4a97e97ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.108289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6104be80705247d9a9b4b7c4a97e97ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.125193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 830/1648] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:08 2022] DELETE /identity/v3/users/6104be80705247d9a9b4b7c4a97e97ae => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:09.126744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:09.127537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:09.128654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:09.171901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:09.173123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:09.207552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:09.352935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 819/1649] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:09.427942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:09.430131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:09.464046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324b0f-45b3-4017-a385-c1fa085818ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:09.481896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:09.485007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:09.486715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:09.488221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] PATH_INFO: `/v3/users/4983049d329a449785ce1182b4f4dce5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:09.494687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4983049d329a449785ce1182b4f4dce5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:09.500748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:09.568240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:09.571388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:09.681318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4983049d329a449785ce1182b4f4dce5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.682974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4983049d329a449785ce1182b4f4dce5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.780441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4983049d329a449785ce1182b4f4dce5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.799581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4983049d329a449785ce1182b4f4dce5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.821559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0173df3f-d48f-4122-b8e2-0969d1a26af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4983049d329a449785ce1182b4f4dce5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:09.826173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e19e-9c90-43dd-a998-319911fcf833 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:09.833865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:09.834746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:09.835209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:09.835520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:09.837931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:09.852060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 831/1650] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:09 2022] DELETE /identity/v3/users/4983049d329a449785ce1182b4f4dce5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:09.857065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:09.858780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:09.859894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:09.864674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:09.866204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:09.881787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 820/1651] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:09.928894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:09.930215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:10.135379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 832/1652] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:10.203497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:10.205001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:10.229971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f090-c920-4d5a-9813-309a350028da service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:10.395609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:10.396287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:10.396609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:10.396893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:10.426375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:10.429551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff16c7-13f7-4671-84c6-1ee5a0113536 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:10.469112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 821/1653] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:10.866988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:10.868461 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:10.897129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17940-a882-4899-90a3-a3ebb102df3e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:10.927807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:10.928500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:10.928787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:10.929812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] PATH_INFO: `/v3/projects/7546ec15aa62489c87760b69b8545331` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:10.933063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7546ec15aa62489c87760b69b8545331)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:10.945097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:11.053392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:11.126693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7546ec15aa62489c87760b69b8545331', 'request_id': 'req-32efa34f-7579-491a-9f97-2bd8a832d89d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:11.146911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7546ec15aa62489c87760b69b8545331', 'request_id': 'req-32efa34f-7579-491a-9f97-2bd8a832d89d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:11.167110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7546ec15aa62489c87760b69b8545331', 'request_id': 'req-32efa34f-7579-491a-9f97-2bd8a832d89d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:11.196785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] The token cache is being invalidate because project 7546ec15aa62489c87760b69b8545331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:11.198337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:11.203242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32efa34f-7579-491a-9f97-2bd8a832d89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:11.205799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 833/1654] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:10 2022] DELETE /identity/v3/projects/7546ec15aa62489c87760b69b8545331 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:11.212712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:11.213264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:11.213595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:11.260994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:11.262153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:11.468095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 822/1655] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:11.473295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:11.474208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:11.474639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:11.526548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:11.527905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:11.558492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 834/1656] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:11.562609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:11.577984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb016e7-ed14-4d19-a63d-c8405185ae90 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:11.588076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:11.588781 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:11.589118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:11.590094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:11.590862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:11.591366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:11.594066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:11.598615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:11.623666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:11.623890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 823/1657] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:11.637978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb40c-3b7b-4b56-bbc3-993b6140f07f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:11.646908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:11.647814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:11.648272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:11.648725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:11.650356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:11.655868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:11.755806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 835/1658] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:11 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:11.763278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:11.795647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b0b3e-6f66-47de-9456-c60b649bb768 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:12.001926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:12.003425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.003687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.004999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.009098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:12.022831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:12.095300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 824/1659] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:11 2022] POST /identity/v3/users => generated 282 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:12.101007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.134124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586072a-9d16-4462-af49-deb750267f82 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:12.148565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:12.149893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.150318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.150734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.157826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:12.158789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.161681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:12.162110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:12.191747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 836/1660] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:12.196257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.214886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff4bd4-6b87-45d9-9d68-0b5528c5202e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:12.234894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707b3d-7f62-4a59-8ed7-b32b2cf017ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:12.243279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:12.246827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.250547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.251193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] PATH_INFO: `/v3/projects/d32ac9325e4448fcb074538cacf8f090` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.256083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:12.257027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.257447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.257858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.257983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32ac9325e4448fcb074538cacf8f090)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:12.258816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:12.260107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: WARNING py.warnings [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:04:12.260107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: warnings.warn(msg) Aug 05 20:04:12.260107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: Aug 05 20:04:12.261111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:12.262030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:12.307416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 837/1661] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:12.317059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.358453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db691d6-0a39-438e-b8da-c90ffcf6d31e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:12.372658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:12.373379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.373662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.373944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] PATH_INFO: `/v3/projects/9833ba6e63de478a9b21c6ad33c27fa6/users/bc6f6f6545004eb78b67246b3a6f3389/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.418026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9833ba6e63de478a9b21c6ad33c27fa6, user_id=bc6f6f6545004eb78b67246b3a6f3389, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:12.422380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085bd54-91c2-4c76-9b1c-73ef5a320191 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:12.424483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32ac9325e4448fcb074538cacf8f090', 'request_id': 'req-ff429efd-181f-44fd-bbbb-a112debd2218'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:12.450352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32ac9325e4448fcb074538cacf8f090', 'request_id': 'req-ff429efd-181f-44fd-bbbb-a112debd2218'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:12.493368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 838/1662] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:12 2022] PUT /identity/v3/projects/9833ba6e63de478a9b21c6ad33c27fa6/users/bc6f6f6545004eb78b67246b3a6f3389/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:12.493755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32ac9325e4448fcb074538cacf8f090', 'request_id': 'req-ff429efd-181f-44fd-bbbb-a112debd2218'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:12.500395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:12.502735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:12.507039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:12.591737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] MFA Rules not processed for user `bc6f6f6545004eb78b67246b3a6f3389`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:12.592995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:12.596611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] The token cache is being invalidate because project d32ac9325e4448fcb074538cacf8f090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:12.597714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:12.602774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:12.616177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 825/1663] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:12 2022] DELETE /identity/v3/projects/d32ac9325e4448fcb074538cacf8f090 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:12.620215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.626152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:12.835875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 839/1664] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:12.837066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:12.844235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:12.941704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:12.952532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429efd-181f-44fd-bbbb-a112debd2218 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.001378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:13.030009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe04e1-0487-4205-8121-ceaab482655c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.040670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.042871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.043308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.043960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] PATH_INFO: `/v3/projects/c39f340d77b141f581dce9c25ca3d30c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.048575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39f340d77b141f581dce9c25ca3d30c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:13.051145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:13.130482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.131600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.132054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.132484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] PATH_INFO: `/v3/users/5e6ccc6e45954acf8cac3a6a60219b95` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.138631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6ccc6e45954acf8cac3a6a60219b95)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:13.142826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:13.200338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39f340d77b141f581dce9c25ca3d30c', 'request_id': 'req-5879e609-af60-496f-848a-7e4536c9d0b8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.215576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39f340d77b141f581dce9c25ca3d30c', 'request_id': 'req-5879e609-af60-496f-848a-7e4536c9d0b8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.243295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39f340d77b141f581dce9c25ca3d30c', 'request_id': 'req-5879e609-af60-496f-848a-7e4536c9d0b8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.265856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6ccc6e45954acf8cac3a6a60219b95'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.277924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] The token cache is being invalidate because project c39f340d77b141f581dce9c25ca3d30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:13.278249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.280927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.292539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 840/1665] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:12 2022] DELETE /identity/v3/projects/c39f340d77b141f581dce9c25ca3d30c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:13.293713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:13.299817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:13.304611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6ccc6e45954acf8cac3a6a60219b95'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.305562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6ccc6e45954acf8cac3a6a60219b95'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.341419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6ccc6e45954acf8cac3a6a60219b95'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.356429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3529c4f1-a652-4c8c-b6ae-5604dbe9891d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6ccc6e45954acf8cac3a6a60219b95'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:13.374645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 826/1666] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:12 2022] DELETE /identity/v3/users/5e6ccc6e45954acf8cac3a6a60219b95 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:13.375862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee46d6-9621-41ce-af51-2c652dc8dc42 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.376154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee46d6-9621-41ce-af51-2c652dc8dc42 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.376429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee46d6-9621-41ce-af51-2c652dc8dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.422209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b7ee46d6-9621-41ce-af51-2c652dc8dc42 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:13.431175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b7ee46d6-9621-41ce-af51-2c652dc8dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:13.570061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e609-af60-496f-848a-7e4536c9d0b8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.578134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 827/1667] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:13.583359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.585180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.586605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.587172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.587889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.588190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.588461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.588545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:13.593223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:13.657574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:13.658814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:13.672418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 841/1668] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:13 2022] POST /identity/v3/projects => generated 363 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:13.678046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:13.685975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:13.693788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 828/1669] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:13.694777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:13.720900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf92b7-c987-4ccf-b5fe-78fd4d8d3f23 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.801682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:13.838442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:13.871934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11b1e-61d3-4a44-ac44-c4ff6c085a3c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.885631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.887265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.887265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.887531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.888316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:13.890405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:13.896211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.897256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.897520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.897897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.898715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:13.899124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:13.903219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:13.948043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 829/1670] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:13.949075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:13.950610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 842/1671] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:13 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:13.954581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:13.982333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7695-4722-4b4e-8a2a-1bdf5811ca02 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.989622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c8232-6c07-4068-b78f-b2f8da896a1b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:13.995670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:13.996563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:13.996993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:13.997264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:13.998730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.000353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.000654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.001415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.002269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.002700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.003643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.009724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.021823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 843/1672] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:14.023792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.045017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7822c4-ad9c-4adf-885f-6cd59ea5c984 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.053303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.055210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.055489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.056035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] PATH_INFO: `/v3/projects/dcde5bba11da43f98c7786b5dcc52194/users/c1a2ec60eddb4b7aa417df97687a9c40/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.086304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcde5bba11da43f98c7786b5dcc52194, user_id=c1a2ec60eddb4b7aa417df97687a9c40, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.090839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.101813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 830/1673] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:13 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:14.103188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.116939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 844/1674] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:14 2022] PUT /identity/v3/projects/dcde5bba11da43f98c7786b5dcc52194/users/c1a2ec60eddb4b7aa417df97687a9c40/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:14.121170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.275529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcb4f-b852-4dcc-abe9-fee2c2285305 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.285641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.286592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.287912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.288318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.289638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.291920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.328398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 845/1675] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:14.329663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.357385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a02d-daed-4969-90a3-1696a57140fe admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.367962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.368363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450460-1eec-46c8-afe0-5bf4e8d8f5a3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.369478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.370562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.372009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.373564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.377367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.378650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.379443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.379884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.380196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] PATH_INFO: `/v3/projects/dcde5bba11da43f98c7786b5dcc52194/users/c1a2ec60eddb4b7aa417df97687a9c40/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.383394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcde5bba11da43f98c7786b5dcc52194, user_id=c1a2ec60eddb4b7aa417df97687a9c40, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.387362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94cc3-14e6-4606-98c7-f23a3f059cc8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.417456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 846/1676] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:14 2022] PUT /identity/v3/projects/dcde5bba11da43f98c7786b5dcc52194/users/c1a2ec60eddb4b7aa417df97687a9c40/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:14.432542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.433049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 831/1677] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:14 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:14.433379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.433667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.437032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.462161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21ccd-e31a-42db-88b8-e4548b47a1de admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.502044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] MFA Rules not processed for user `c1a2ec60eddb4b7aa417df97687a9c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:14.503482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:14.615278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.616501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.617620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.617903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.618875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.622245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.661818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 832/1678] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:14.662823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.685018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64315ae8-3e25-4c48-a6b0-3d1bbbf9f456 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.688052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 847/1679] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:14.704901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.709673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:14.723084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.727275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.727564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.727865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.734480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.736596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.754361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:14.776775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 833/1680] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:14.785705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.829532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c541-764f-4cb6-a242-a50e16ea0844 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.851220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.854116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.854319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.854553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] PATH_INFO: `/v3/projects/5c251c5f6f304b92a847ab0841b4086e/users/dae8a3bfa1e146bc89e2c174c32c4bba/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.882161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:14.890152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c251c5f6f304b92a847ab0841b4086e, user_id=dae8a3bfa1e146bc89e2c174c32c4bba, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.895244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.902893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604745be-cd54-4b73-9ed8-03d2571065ae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:14.916363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:14.917015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.917298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.917590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:14.918932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 834/1681] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:14 2022] PUT /identity/v3/projects/5c251c5f6f304b92a847ab0841b4086e/users/dae8a3bfa1e146bc89e2c174c32c4bba/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:14.920112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:14.922018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:14.953150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:14.954624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf41c-01fd-42e7-93b1-b5571a5222e4 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:14.990353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 848/1682] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:14.991851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efdb0-2bae-4c0e-bc80-7b3dd6550abe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:14.992144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efdb0-2bae-4c0e-bc80-7b3dd6550abe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:14.992419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efdb0-2bae-4c0e-bc80-7b3dd6550abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.059423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dcb6d-1efc-4096-a925-50b84e713e9f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.078327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.080106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.080418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.080691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] PATH_INFO: `/v3/projects/584d9778907b47bab18290ed8b68c947` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.084909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584d9778907b47bab18290ed8b68c947)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.091160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.093014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1d8efdb0-2bae-4c0e-bc80-7b3dd6550abe None None] MFA Rules not processed for user `dae8a3bfa1e146bc89e2c174c32c4bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:15.106612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1d8efdb0-2bae-4c0e-bc80-7b3dd6550abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.195811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584d9778907b47bab18290ed8b68c947', 'request_id': 'req-ea74c930-6e28-4696-9960-e94e7eb40b70'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:15.212684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584d9778907b47bab18290ed8b68c947', 'request_id': 'req-ea74c930-6e28-4696-9960-e94e7eb40b70'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:15.231986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584d9778907b47bab18290ed8b68c947', 'request_id': 'req-ea74c930-6e28-4696-9960-e94e7eb40b70'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:15.265493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] The token cache is being invalidate because project 584d9778907b47bab18290ed8b68c947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:15.267595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:15.269675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:15.278755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 835/1683] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:14 2022] DELETE /identity/v3/projects/584d9778907b47bab18290ed8b68c947 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:15.278755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.282428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.304459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 849/1684] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:15.309049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485182c-3cbf-4641-810a-cdc4205bf548 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.309341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485182c-3cbf-4641-810a-cdc4205bf548 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.309856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485182c-3cbf-4641-810a-cdc4205bf548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.366579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a485182c-3cbf-4641-810a-cdc4205bf548 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:15.367741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a485182c-3cbf-4641-810a-cdc4205bf548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.417031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c930-6e28-4696-9960-e94e7eb40b70 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.420967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.421610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.421886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.422170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.425780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.479671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:15.520503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.522038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.542121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 836/1685] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:15.543145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.544575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.567843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 850/1686] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:15.568167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae974-479e-4a68-b9ae-427c2bc16a0d service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.579141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.579438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.579717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.582940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.584406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.585064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.588212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.589439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.594217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.621092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:15.623811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:15.646113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 837/1687] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:15 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:15.652537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.654799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 851/1688] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:15.658459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.690934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c0125-01fc-4989-87d4-c26041c67c79 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.783058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:15.807469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8466fba-5cba-4257-b57e-b66559ff2924 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.819161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.820096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.820455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.820889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.824181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.829435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.863736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.864570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.864844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.865113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.865822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:15.866120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.867717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.879442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 838/1689] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:15 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:15.881935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.888053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 852/1690] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:15.889180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.900954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e26be-4829-42f0-869c-59f11fa88cf8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.906999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f0ef-a706-4e81-ae82-9bb5224064e1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.907350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.908486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.908933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.909208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.910830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.915074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.921471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.922243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.922614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.923403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:15.923859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:15.938007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 839/1691] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:15.938165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:15.939673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:15.958743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18075d-8a00-4ac7-a597-92609fb4bd38 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:15.971224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:15.973162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:15.974494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:15.977289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] PATH_INFO: `/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942/users/0be54a40e0fb4febae30588270141a68/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.001865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb2d1f05b064fb28cddcb4fdb5f0942, user_id=0be54a40e0fb4febae30588270141a68, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.006309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.039325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 853/1693] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:15 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:16.040014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 840/1693] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:15 2022] PUT /identity/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942/users/0be54a40e0fb4febae30588270141a68/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:16.045207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.045646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.178658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3e014-71c8-439f-a2d2-e741fcb56c97 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.190363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089abb8-5ae7-435a-a09f-2cc9aa808472 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.197860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.198558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.198901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.199167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.199939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.201931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.209811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.210132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.210869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.210869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.211620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.213752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.238564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 841/1694] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:16.241510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.264313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:16.268439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 854/1695] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:16 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:16.271425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58fa14-bd6b-433e-9be2-c87c1fc1718e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.273738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.293779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.295736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.296051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.296325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] PATH_INFO: `/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942/users/0be54a40e0fb4febae30588270141a68/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.307442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb2d1f05b064fb28cddcb4fdb5f0942, user_id=0be54a40e0fb4febae30588270141a68, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.309277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f01d-50e3-4b61-8a78-bc6e4fa8f01f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.314526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.339114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.339756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.340076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.340349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.341484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.342641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81205c3-90e3-4636-8d50-806ca541271a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.358264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 842/1696] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:16 2022] PUT /identity/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942/users/0be54a40e0fb4febae30588270141a68/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:16.361848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 855/1697] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:16.372289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.381751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.383138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.383525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.487142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] MFA Rules not processed for user `0be54a40e0fb4febae30588270141a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:16.491349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:16.532178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a874c8-2b4c-419b-9d63-d80f2381a0db admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.542109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.542671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.542951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.543223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.543962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.548832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.575054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 843/1698] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:16.577101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.611480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d3341-c82d-4ca7-83f7-2e4311dffcad admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.633383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.634058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.634339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.634617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] PATH_INFO: `/v3/projects/13f6bedcdb544d328b532947854b7a43/users/52245d22305245b38aa974b313307271/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.663137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f6bedcdb544d328b532947854b7a43, user_id=52245d22305245b38aa974b313307271, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:16.665834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c17f5-b5fd-48cd-98d6-e861f1a47ac9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:16.690530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 856/1699] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:16.706595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.719428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 844/1700] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:16 2022] PUT /identity/v3/projects/13f6bedcdb544d328b532947854b7a43/users/52245d22305245b38aa974b313307271/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:16.721340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.721629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.722495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:16.740570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:16.786755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] MFA Rules not processed for user `52245d22305245b38aa974b313307271`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:16.788064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:16.854451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f197a-e548-4124-8514-e9264a5d10ff None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:16.950121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 845/1701] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:16.952001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:16.955942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:16.960123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:16.960692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:16.961140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.031291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:17.055155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0878ea9-f9e5-462a-9438-849e6d2dc964 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.065189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.072151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.072553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.072883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.073612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.078040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5088-0697-4087-9462-1515c4b104e5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.124927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.132724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.138864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 846/1702] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:16 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:17.139646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.139956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.140229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.155328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 857/1703] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:17.188606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] MFA Rules not processed for user `edf898f67aca42db8d51924ca4d8a300`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:17.190359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:17.197324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:17.225389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116aa-855e-4dcb-b26b-11423c1df60c service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.379014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 847/1704] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:17.395443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:17.398828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:17.433421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.434436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.434436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.434563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.435552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.437447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.485401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 858/1705] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:17 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:17.497153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:17.521878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c309af-98fd-4315-91f7-b8e80ed853a1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.543434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.544416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.545999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.545999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.545999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.547559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.549588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:17.566738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 859/1706] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:17.570594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:17.594136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aaa63-9257-4c30-bb79-7f063856d3a1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.607233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.607924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.608276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.608644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] PATH_INFO: `/v3/projects/14fd05599717404ea9366aa794045ec7/users/67772584fd974337bf529d3eaf14e9d1/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.659038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fd05599717404ea9366aa794045ec7, user_id=67772584fd974337bf529d3eaf14e9d1, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.662076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.669339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adca80-ef7e-4424-b1f4-5f0041298276 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.688480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.690818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.691575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.691795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:17.694527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 860/1707] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:17 2022] PUT /identity/v3/projects/14fd05599717404ea9366aa794045ec7/users/67772584fd974337bf529d3eaf14e9d1/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:17.703512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:17.725082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:17.726750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:17.754879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 848/1708] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:17.982248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4c92-9ec8-42ee-a047-486893010fbc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:17.998767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:17.999415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:17.999790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:17.999985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.000764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.007514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bae64-a9cd-4ea1-9c44-e6760dfea908 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.027405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 861/1709] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:18.031536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.062410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f804-3efe-4f01-b43c-170262f2965e service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.074534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.075562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.076083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.076567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] PATH_INFO: `/v3/projects/14fd05599717404ea9366aa794045ec7/users/67772584fd974337bf529d3eaf14e9d1/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.081285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fd05599717404ea9366aa794045ec7, user_id=67772584fd974337bf529d3eaf14e9d1, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.090353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.108711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 849/1710] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:18 2022] PUT /identity/v3/projects/14fd05599717404ea9366aa794045ec7/users/67772584fd974337bf529d3eaf14e9d1/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:18.121085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.121441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.121786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.184813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] MFA Rules not processed for user `67772584fd974337bf529d3eaf14e9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:18.186129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:18.276026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.404201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 862/1711] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:18.444696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.453226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:18.501094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4229f-d034-4b86-ad63-cb7abc941044 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.518583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be54a40e0fb4febae30588270141a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.528102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.528409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.528687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.534091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:18.535423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.546057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.583502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec036-3837-40e7-b18a-65bf9c541c9a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.593271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.593954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.594232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.594542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.596596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 850/1712] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:18.601668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.614831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:18.619651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.622706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.648941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 863/1713] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:18.663096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe647b-c858-4799-8597-705465aaab9c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.685981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be54a40e0fb4febae30588270141a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.686638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.686921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.687192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.695380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.696530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.715348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.848021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 851/1714] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:18 2022] POST /identity/v3/projects => generated 354 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:18.851518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:18.854128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:18.954325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad288-4d12-4cd2-884f-dd2953ed17e9 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.968258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.969362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f2be8-1b65-46b9-b9f2-4e2e13e6f76a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:18.970161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.970533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.970953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] PATH_INFO: `/v3/users/52245d22305245b38aa974b313307271` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.977645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52245d22305245b38aa974b313307271)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.981476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:18.982660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:18.983500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:18.983790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:18.985225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] PATH_INFO: `/v3/users/ff9fe36ed9004b5ca3c495e282168073` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:18.986764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9fe36ed9004b5ca3c495e282168073)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:18.991368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.103467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52245d22305245b38aa974b313307271'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.105498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52245d22305245b38aa974b313307271'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.117274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9fe36ed9004b5ca3c495e282168073'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.126742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52245d22305245b38aa974b313307271'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.139542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52245d22305245b38aa974b313307271'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.142583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9fe36ed9004b5ca3c495e282168073'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.148872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9fe36ed9004b5ca3c495e282168073'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.151584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52245d22305245b38aa974b313307271'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.164470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 864/1715] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:18 2022] DELETE /identity/v3/users/52245d22305245b38aa974b313307271 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:19.165980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:19.172120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.190516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9fe36ed9004b5ca3c495e282168073'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.203586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cd70e988-6ffe-47bd-8874-77b5f63530a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9fe36ed9004b5ca3c495e282168073'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.217841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 852/1716] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:18 2022] DELETE /identity/v3/users/ff9fe36ed9004b5ca3c495e282168073 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:19.220779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c4549-762e-4b30-80c1-ae7cd59844e1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.221068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c4549-762e-4b30-80c1-ae7cd59844e1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.221383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c4549-762e-4b30-80c1-ae7cd59844e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.254383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-318c4549-762e-4b30-80c1-ae7cd59844e1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:19.256042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-318c4549-762e-4b30-80c1-ae7cd59844e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.291912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:19.313583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8ef1-3503-4f04-b8f3-32ac20eaf2c7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:19.342642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:19.349855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 853/1717] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:19.351446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.352051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.352463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.385912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:19.387117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.396966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 854/1718] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:19.397894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:19.399608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.430482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be54a40e0fb4febae30588270141a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:19.431494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.432588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.433064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.433993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:19.434496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:19.436505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.490018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 865/1719] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:19.491137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:19.524857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8af8-5e42-476a-9eec-50c96ac65fa3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:19.533801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aa879-19a2-4f1c-a60f-38f079c38b4c tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:19.539515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:19.542041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.543446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.546710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.552897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:19.553916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.555949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.556336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.586469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:19.591167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.591457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:19.594305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.620521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 866/1720] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:19.625243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:19.626301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 855/1721] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:19.626931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.658588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4024a-4810-4f16-89e0-67d2eab168d7 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:19.691455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be54a40e0fb4febae30588270141a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:19.692479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.692765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.693044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] PATH_INFO: `/v3/projects/b397f4ee384442c89de90143390f582c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.695918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b397f4ee384442c89de90143390f582c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:19.697848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.736561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:19.738613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:19.761810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aeb3f-5105-4880-b576-1b0d964e201e service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:19.776899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:19.777568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:19.777846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:19.778124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] PATH_INFO: `/v3/users/bc6f6f6545004eb78b67246b3a6f3389` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:19.781579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6f6f6545004eb78b67246b3a6f3389)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:19.783544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:19.826322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b397f4ee384442c89de90143390f582c', 'request_id': 'req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.839878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b397f4ee384442c89de90143390f582c', 'request_id': 'req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.858917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b397f4ee384442c89de90143390f582c', 'request_id': 'req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.890583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] The token cache is being invalidate because project b397f4ee384442c89de90143390f582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:19.890897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.891830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14c46ec5-72bb-4786-aaab-5edbc1a8b60a tempest-VolumeQuotaClassesTest-588740180 tempest-VolumeQuotaClassesTest-588740180-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.893553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 867/1722] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:19 2022] DELETE /identity/v3/projects/b397f4ee384442c89de90143390f582c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:19.923369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6f6f6545004eb78b67246b3a6f3389'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.944155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6f6f6545004eb78b67246b3a6f3389'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.946219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6f6f6545004eb78b67246b3a6f3389'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:19.983704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6f6f6545004eb78b67246b3a6f3389'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.010889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6f6f6545004eb78b67246b3a6f3389'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.088932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:20.089330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:20.089530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:20.104801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 856/1723] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:19 2022] DELETE /identity/v3/users/bc6f6f6545004eb78b67246b3a6f3389 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:20.153495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:20.155464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.291646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 868/1724] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:20.348011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:20.350258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.377732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757899-c248-4938-a86d-d6ab8807cba5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:20.417587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:20.419549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:20.425114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:20.426147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] PATH_INFO: `/v3/users/dae8a3bfa1e146bc89e2c174c32c4bba` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:20.430154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae8a3bfa1e146bc89e2c174c32c4bba)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:20.433465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:20.468927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:20.470737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.558610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:20.609866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:20.647316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae8a3bfa1e146bc89e2c174c32c4bba'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.653762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8b49-7799-4bfc-9da3-86a554623ba6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:20.671375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae8a3bfa1e146bc89e2c174c32c4bba'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.672421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:20.673419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:20.673419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:20.673577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:20.680310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae8a3bfa1e146bc89e2c174c32c4bba'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.686081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.727470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:20.728969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:20.733163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae8a3bfa1e146bc89e2c174c32c4bba'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.749487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-53bd2533-c821-47ad-97e9-1e4c0838273a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae8a3bfa1e146bc89e2c174c32c4bba'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:20.759267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 869/1725] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:20.763173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 857/1726] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:20 2022] DELETE /identity/v3/users/dae8a3bfa1e146bc89e2c174c32c4bba => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:20.764476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9604d4-e779-4cdc-9dda-58ad662ee1f3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:20.764762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9604d4-e779-4cdc-9dda-58ad662ee1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:20.765038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9604d4-e779-4cdc-9dda-58ad662ee1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:20.782266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:20.785313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.826463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd45e5-5f11-4c78-bf82-e7d43b100bc9 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:20.875966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5b9604d4-e779-4cdc-9dda-58ad662ee1f3 None None] MFA Rules not processed for user `083840b9867145389ebf9cb035f0aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:20.877208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5b9604d4-e779-4cdc-9dda-58ad662ee1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:20.998239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:20.998907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:20.999185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:20.999455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] PATH_INFO: `/v3/users/2dc7c2d3652843668e855c81f6a77f1b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.001406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc7c2d3652843668e855c81f6a77f1b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:21.004304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:21.055847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 858/1727] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:21.055847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed109-7f10-4bff-899b-f6b2f4d965c7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.055847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed109-7f10-4bff-899b-f6b2f4d965c7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.055847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed109-7f10-4bff-899b-f6b2f4d965c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.096724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c7eed109-7f10-4bff-899b-f6b2f4d965c7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:21.100716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c7eed109-7f10-4bff-899b-f6b2f4d965c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.102514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc7c2d3652843668e855c81f6a77f1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:21.103371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc7c2d3652843668e855c81f6a77f1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:21.125481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 859/1728] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:21.126940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.127226 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.129487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.134678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc7c2d3652843668e855c81f6a77f1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:21.149389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc7c2d3652843668e855c81f6a77f1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:21.171621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-756c2535-1728-4a1e-b8bc-1006f51bcd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc7c2d3652843668e855c81f6a77f1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:21.193013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 870/1729] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:20 2022] DELETE /identity/v3/users/2dc7c2d3652843668e855c81f6a77f1b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:21.198429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf1d8-aee6-4efb-8c6a-2ba229df811e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.200867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf1d8-aee6-4efb-8c6a-2ba229df811e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.201686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf1d8-aee6-4efb-8c6a-2ba229df811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.232123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] MFA Rules not processed for user `67e79817ed9e40728f92a22053a24118`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:21.239881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.289641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-082cf1d8-aee6-4efb-8c6a-2ba229df811e None None] MFA Rules not processed for user `083840b9867145389ebf9cb035f0aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:21.297407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-082cf1d8-aee6-4efb-8c6a-2ba229df811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.466893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:21.514119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 871/1730] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:21.516106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.516624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.517135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.528272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 860/1731] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:21.528272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:21.528272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.562536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:21.564368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.606763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:21.707078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e646ee-cabb-4e98-988a-06be2b70e95c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:21.712066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:21.712912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 872/1732] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:21.714064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:21.715237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.715669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.715917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.716379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.766881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:21.780048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:21.811334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 861/1733] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:21.812415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:21.815139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.875340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aeb21f-6bbf-4b70-ae69-2a343efdb08e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:21.895946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:21.896598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.896875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.897143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.899985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.924063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:21.925761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:21.946864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 873/1734] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:21.948305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:21.950415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:21.978586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a079de-26cf-4bb8-9fd0-d11cfce30b99 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:21.992541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:21.993214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:21.993492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:21.993763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] PATH_INFO: `/v3/projects/ee40a4f040bd4984967cde7e4084f054` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:21.994982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee40a4f040bd4984967cde7e4084f054)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:21.997024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.045800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece083b6-b62c-4571-bf14-44675a1b11fd service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.062811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.064862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.065245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.065619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.089192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.090914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.094949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee40a4f040bd4984967cde7e4084f054', 'request_id': 'req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.101797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee40a4f040bd4984967cde7e4084f054', 'request_id': 'req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.117382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee40a4f040bd4984967cde7e4084f054', 'request_id': 'req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.118308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 862/1735] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:22.119153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.122263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.145856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] The token cache is being invalidate because project ee40a4f040bd4984967cde7e4084f054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:22.146143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.149969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.151942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 874/1736] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:21 2022] DELETE /identity/v3/projects/ee40a4f040bd4984967cde7e4084f054 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:22.152764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.156494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.166032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1eac8-3447-44c6-b116-7ca05a067e43 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.168190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:22.306099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a8b0-9213-4f59-97cd-a16ee4daa8ec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.313088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.313947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.314479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.315046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.317961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.326580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.327247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.327529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.327821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] PATH_INFO: `/v3/projects/13f6bedcdb544d328b532947854b7a43` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.332818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f6bedcdb544d328b532947854b7a43)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.333064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.334728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71578d9a-bcbc-4360-a45c-1f147050ae15 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.334855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.346767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 875/1737] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:22.348865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b264-7f8f-4c1a-8219-dc5e82559f69 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.349311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b264-7f8f-4c1a-8219-dc5e82559f69 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.349806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b264-7f8f-4c1a-8219-dc5e82559f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.380669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d675b264-7f8f-4c1a-8219-dc5e82559f69 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:22.382154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d675b264-7f8f-4c1a-8219-dc5e82559f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.393637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 876/1738] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:22.402029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.402550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.403015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.435591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:22.437603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.471132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f6bedcdb544d328b532947854b7a43', 'request_id': 'req-43626b6c-7a51-48ca-a209-081755b94db6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.477235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:22.490162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f6bedcdb544d328b532947854b7a43', 'request_id': 'req-43626b6c-7a51-48ca-a209-081755b94db6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.504589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f6bedcdb544d328b532947854b7a43', 'request_id': 'req-43626b6c-7a51-48ca-a209-081755b94db6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.529067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] The token cache is being invalidate because project 13f6bedcdb544d328b532947854b7a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:22.529365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.531834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.535580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 863/1739] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:22 2022] DELETE /identity/v3/projects/13f6bedcdb544d328b532947854b7a43 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:22.539722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.543896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.553408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 877/1740] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:22.557418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.576612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e49d6-8690-4f74-b3ea-3d93e9439fe0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.580984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43626b6c-7a51-48ca-a209-081755b94db6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.591168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.591840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.592130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.592798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.593177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.593577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:22.593842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.593950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.594122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.595532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.596560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] PATH_INFO: `/v3/users/67772584fd974337bf529d3eaf14e9d1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.599521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67772584fd974337bf529d3eaf14e9d1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.605181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.627879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 878/1741] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:22.632588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.655405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952b63-2327-4cff-a167-516e471b8e0d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.672482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:22.674566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.674906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.676648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.677761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:22.684654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:22.716706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67772584fd974337bf529d3eaf14e9d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.730676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67772584fd974337bf529d3eaf14e9d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.732371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67772584fd974337bf529d3eaf14e9d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.760891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 879/1742] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:22 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:22.762483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.765094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.789417 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67772584fd974337bf529d3eaf14e9d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.806264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9647c81c-5e97-46f8-8c96-0fd95f112263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67772584fd974337bf529d3eaf14e9d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:22.818723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 864/1743] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:22 2022] DELETE /identity/v3/users/67772584fd974337bf529d3eaf14e9d1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:22.820790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:22.821148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:22.821529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:22.847425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] MFA Rules not processed for user `edf898f67aca42db8d51924ca4d8a300`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:22.849472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:22.913986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dded2-6700-4744-bc60-32d4c025b5a3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:22.934856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:22.953462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 865/1744] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:22.954974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:22.957093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:23.103133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:23.103940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.104222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.104494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] PATH_INFO: `/v3/projects/9833ba6e63de478a9b21c6ad33c27fa6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.107331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9833ba6e63de478a9b21c6ad33c27fa6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:23.109307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:23.184131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3da9-1d03-456f-a21b-bf898ac41494 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:23.192263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:23.193127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.193406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.193681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.194371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:23.199396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:23.224794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9833ba6e63de478a9b21c6ad33c27fa6', 'request_id': 'req-c3e69c72-3169-4591-856f-f45ee82521b9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.228512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:23.241063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9833ba6e63de478a9b21c6ad33c27fa6', 'request_id': 'req-c3e69c72-3169-4591-856f-f45ee82521b9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.253189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9833ba6e63de478a9b21c6ad33c27fa6', 'request_id': 'req-c3e69c72-3169-4591-856f-f45ee82521b9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.263964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 866/1745] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:22 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:23.266041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:23.271211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:23.279287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] The token cache is being invalidate because project 9833ba6e63de478a9b21c6ad33c27fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:23.280267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.280881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.286056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 880/1746] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:22 2022] DELETE /identity/v3/projects/9833ba6e63de478a9b21c6ad33c27fa6 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:23.286657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:23.291005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:23.294250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a38c6-9523-4f07-a7ff-2637a78d4e9b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:23.409333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:23.410728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.411168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.412062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] PATH_INFO: `/v3/projects/5c251c5f6f304b92a847ab0841b4086e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.431651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c251c5f6f304b92a847ab0841b4086e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:23.444353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69c72-3169-4591-856f-f45ee82521b9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:23.446608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:23.473105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:23.473761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.474041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.474314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.475037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:23.476690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:23.522938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 881/1747] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:23.534347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:23.543745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:23.586529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cfaa-573a-4da2-bbf2-247b7c402215 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:23.603655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:23.604344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.606873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.606873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] PATH_INFO: `/v3/users/c1a2ec60eddb4b7aa417df97687a9c40` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.620986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a2ec60eddb4b7aa417df97687a9c40)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:23.626719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:23.702887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c251c5f6f304b92a847ab0841b4086e', 'request_id': 'req-be3a8048-d1bf-4e54-8eec-e756fb4f708c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.720585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c251c5f6f304b92a847ab0841b4086e', 'request_id': 'req-be3a8048-d1bf-4e54-8eec-e756fb4f708c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.735008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c251c5f6f304b92a847ab0841b4086e', 'request_id': 'req-be3a8048-d1bf-4e54-8eec-e756fb4f708c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.767599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:23.777854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] The token cache is being invalidate because project 5c251c5f6f304b92a847ab0841b4086e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:23.778669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.780034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be3a8048-d1bf-4e54-8eec-e756fb4f708c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.788269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 867/1748] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:23 2022] DELETE /identity/v3/projects/5c251c5f6f304b92a847ab0841b4086e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:23.792497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:23.793086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:23.793202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:23.796827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 868/1749] 10.222.0.95 () {54 vars in 912 bytes} [Fri Aug 5 20:04:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:23.803579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:23.807469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:23.810697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a2ec60eddb4b7aa417df97687a9c40'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.817566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a2ec60eddb4b7aa417df97687a9c40'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.857225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a2ec60eddb4b7aa417df97687a9c40'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.875603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a2ec60eddb4b7aa417df97687a9c40'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.898274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a2ec60eddb4b7aa417df97687a9c40'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:23.918712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 882/1750] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:23 2022] DELETE /identity/v3/users/c1a2ec60eddb4b7aa417df97687a9c40 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:23.918712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:23.920132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:24.010409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0284-56fd-4660-9d7e-56360e9fb982 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:24.100151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:24.110825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40c6b-f4a1-47d3-86a9-a53491a53008 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:24.130042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:24.130728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.131011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.131286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] PATH_INFO: `/v3/projects/14fd05599717404ea9366aa794045ec7` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.132742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fd05599717404ea9366aa794045ec7)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:24.134662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:24.188408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:24.190273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.190584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.190929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.192067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:24.193854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:24.231907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fd05599717404ea9366aa794045ec7', 'request_id': 'req-319ea53b-e8b0-44d9-897e-c22f151fe1ce'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.241261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fd05599717404ea9366aa794045ec7', 'request_id': 'req-319ea53b-e8b0-44d9-897e-c22f151fe1ce'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.258867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fd05599717404ea9366aa794045ec7', 'request_id': 'req-319ea53b-e8b0-44d9-897e-c22f151fe1ce'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.278173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 869/1751] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:24.280690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:24.282455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] The token cache is being invalidate because project 14fd05599717404ea9366aa794045ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:24.282752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.284479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:24.287165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-319ea53b-e8b0-44d9-897e-c22f151fe1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.292624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 883/1752] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:23 2022] DELETE /identity/v3/projects/14fd05599717404ea9366aa794045ec7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:24.305509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.306790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.307333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.317391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d4bc-1d60-4404-85f2-5d94442e70ed admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:24.396308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:24.397833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:24.458376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:24.476206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:24.478743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.479035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.479307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] PATH_INFO: `/v3/users/0be54a40e0fb4febae30588270141a68` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.483990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be54a40e0fb4febae30588270141a68)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:24.492321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:24.547936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 884/1753] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:24.548816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:24.551817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:24.593481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209db6-7c29-45cd-9972-4eb3465b619c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:24.605731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be54a40e0fb4febae30588270141a68'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.609366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:24.610399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.610682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.613320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] PATH_INFO: `/v3/projects/4d53bf6f50b2493b86d412684ca37345` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.622302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d53bf6f50b2493b86d412684ca37345)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:24.625082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:24.631703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be54a40e0fb4febae30588270141a68'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.633224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be54a40e0fb4febae30588270141a68'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.685253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be54a40e0fb4febae30588270141a68'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.704037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be54a40e0fb4febae30588270141a68'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.725204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 870/1754] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:24 2022] DELETE /identity/v3/users/0be54a40e0fb4febae30588270141a68 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:24.725204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:24.729684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:24.812199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d53bf6f50b2493b86d412684ca37345', 'request_id': 'req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.829381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d53bf6f50b2493b86d412684ca37345', 'request_id': 'req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.849529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d53bf6f50b2493b86d412684ca37345', 'request_id': 'req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.887417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] The token cache is being invalidate because project 4d53bf6f50b2493b86d412684ca37345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:24.887710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.889930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:24.890418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a4ad367-ae0a-4d47-ae0d-df8d087d8452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:24.897375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 885/1755] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:24 2022] DELETE /identity/v3/projects/4d53bf6f50b2493b86d412684ca37345 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:24.898442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:24.898723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:24.898991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:24.946172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff60-795f-41b7-be49-781d2e919ba9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:24.964153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:24.965393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.125210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 886/1756] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:25.126389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.126790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.127493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.129191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.129343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.129610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] PATH_INFO: `/v3/projects/6634f8d7489a42d4b777f1d4bb892a9c/users/b95e32006fdf4a14b192542c81b40149/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.147584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976179-f2fa-404d-9799-a62dbec7d92e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:25.163939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.164737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.165218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.165622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] PATH_INFO: `/v3/projects/dcde5bba11da43f98c7786b5dcc52194` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.167273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcde5bba11da43f98c7786b5dcc52194)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.169356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.171063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6634f8d7489a42d4b777f1d4bb892a9c, user_id=b95e32006fdf4a14b192542c81b40149, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.179029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9aabd-7a40-4b80-a6c5-95bff7408058 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.213757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 871/1757] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:24 2022] PUT /identity/v3/projects/6634f8d7489a42d4b777f1d4bb892a9c/users/b95e32006fdf4a14b192542c81b40149/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:25.215985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409144-21c2-4095-b400-421bebace634 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.216449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409144-21c2-4095-b400-421bebace634 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.216870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409144-21c2-4095-b400-421bebace634 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.218589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 872/1758] 10.222.0.95 () {54 vars in 912 bytes} [Fri Aug 5 20:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:25.219858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409144-21c2-4095-b400-421bebace634 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.223607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f409144-21c2-4095-b400-421bebace634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.315721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcde5bba11da43f98c7786b5dcc52194', 'request_id': 'req-98f82952-b12e-4edd-86b6-87fc0a6b07ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.326356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409144-21c2-4095-b400-421bebace634 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:25.338204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcde5bba11da43f98c7786b5dcc52194', 'request_id': 'req-98f82952-b12e-4edd-86b6-87fc0a6b07ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.339717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:25.353897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcde5bba11da43f98c7786b5dcc52194', 'request_id': 'req-98f82952-b12e-4edd-86b6-87fc0a6b07ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.376969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] The token cache is being invalidate because project dcde5bba11da43f98c7786b5dcc52194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:25.377530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.380480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.384349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 887/1759] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:25 2022] DELETE /identity/v3/projects/dcde5bba11da43f98c7786b5dcc52194 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:25.387395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.392667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.399078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.400679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.401213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.402845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.404999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.430894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.432674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42694be-068f-45de-9054-0b82f3fb1d31 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.457267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 873/1760] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:25.457267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a966ea-104f-4df4-afc9-7524eb5ec306 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.457267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a966ea-104f-4df4-afc9-7524eb5ec306 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.457267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a966ea-104f-4df4-afc9-7524eb5ec306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.484518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-83a966ea-104f-4df4-afc9-7524eb5ec306 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:25.485884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-83a966ea-104f-4df4-afc9-7524eb5ec306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.538299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:25.558069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82952-b12e-4edd-86b6-87fc0a6b07ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:25.563950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.564884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.565346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.565837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] PATH_INFO: `/v3/users/25ccbe0b506f466d93630b490ef06760` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.568172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ccbe0b506f466d93630b490ef06760)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.570439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.599773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 874/1761] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:25.601419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743a48-f67b-45f4-93b5-8ff3daca46b4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.602270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743a48-f67b-45f4-93b5-8ff3daca46b4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.602663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9743a48-f67b-45f4-93b5-8ff3daca46b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.629510 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d9743a48-f67b-45f4-93b5-8ff3daca46b4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:25.631529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d9743a48-f67b-45f4-93b5-8ff3daca46b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.638753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ccbe0b506f466d93630b490ef06760'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.640408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ccbe0b506f466d93630b490ef06760'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.641953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 875/1762] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:25.648113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.648497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.648835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.656831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ccbe0b506f466d93630b490ef06760'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.667646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ccbe0b506f466d93630b490ef06760'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.677637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:25.678485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-04fb66df-2be6-46e2-a68b-bdf168c8592b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ccbe0b506f466d93630b490ef06760'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.679314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.686456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 888/1763] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:25 2022] DELETE /identity/v3/users/25ccbe0b506f466d93630b490ef06760 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:25.687878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.688774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.688774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.692369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 876/1764] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:25.693238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.694679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.711277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:25.711505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e206-2fd5-468a-a50f-bf9cd1030a56 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:25.712731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.791909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 889/1765] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:25.791909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.791909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.797031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:25.809506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef4d4-33d6-4fed-affb-3c350a5d7f4a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:25.817826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.819526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.820085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.820471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.821367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:25.821743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.823706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.838403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:25.839431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 890/1766] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:25.839699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:25.840330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:25.840756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] PATH_INFO: `/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:25.840898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:25.843042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb2d1f05b064fb28cddcb4fdb5f0942)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:25.843862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:25.846733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:25.947881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'request_id': 'req-9f7a4a7f-5155-43fe-80e0-16df0081e735'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.963864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'request_id': 'req-9f7a4a7f-5155-43fe-80e0-16df0081e735'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:25.979273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb2d1f05b064fb28cddcb4fdb5f0942', 'request_id': 'req-9f7a4a7f-5155-43fe-80e0-16df0081e735'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:26.010262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8785c2-c64b-4e28-b50a-e90960f0ed7d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.011127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] The token cache is being invalidate because project bfb2d1f05b064fb28cddcb4fdb5f0942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:26.011506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:26.014745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:26.018156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 877/1767] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:25 2022] DELETE /identity/v3/projects/bfb2d1f05b064fb28cddcb4fdb5f0942 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:26.021665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.027149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.108213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:26.121303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a4a7f-5155-43fe-80e0-16df0081e735 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.130294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.131194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.131649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.132034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.133740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.134706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.134995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.135272 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.137170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.137446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.186340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.193683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25295f0-2204-4e28-ab5f-4d666916bf76 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.219726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 878/1768] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:26.221635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.224415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.225281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.277660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:26.280983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.298199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.299945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3bd9b-befe-4225-b072-0a4b0392ec36 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.305184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 879/1769] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:26.306101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.312718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.312904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 891/1770] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:26.314281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.314658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.315025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.339314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe3dad-f97c-4f61-89cb-83ec55a5e4ad None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.339768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:26.341482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.350770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.351757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.351757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.353083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.354994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.358510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 892/1771] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:26.358510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.360910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.383487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc46e69-bfd8-47ed-846e-ad6b6b3100d8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.396883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.397539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.399711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.400094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.400921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:26.402761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.406856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee946880-a227-4870-a9cf-d9aee5c33f1e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.438060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 893/1772] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:26.439137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 880/1773] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:26.439315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.439713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.440104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.443319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.477738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:26.481904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.615168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:26.649252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b22e7-4581-4c3f-94f0-b98bb52c074a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.677998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.678653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.678935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.679209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.679950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.684620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab85a4-45c7-42ba-b6ae-e9b86051c8f4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.710408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 894/1774] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:26.711827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.729915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 881/1775] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:26.731352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de9c5-b6da-4238-80e6-1e924088a46b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.731642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de9c5-b6da-4238-80e6-1e924088a46b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.731942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de9c5-b6da-4238-80e6-1e924088a46b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.744821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5fdf7-1edd-448e-b861-2cc811088afe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.750300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.751995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.752286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.752562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.754549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.756901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 882/1776] 10.222.0.95 () {54 vars in 961 bytes} [Fri Aug 5 20:04:26 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:26.757878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4de9c5-b6da-4238-80e6-1e924088a46b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.767068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.779699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4de9c5-b6da-4238-80e6-1e924088a46b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.785882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.787002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.787342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.787623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.788571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:26.790555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.792647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:26.812145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 883/1777] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:26.813100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.828071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b4df-0ca6-4856-bdba-dd58a4ba7c36 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:26.830793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 895/1778] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:26 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:26.832345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:26.836803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:26.981733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:26.983001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:26.983285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:26.983559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:26.985963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:26.991812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fada1ad-792f-4909-b6f3-4e23593ac14c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.010190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ef72-508d-4163-86e9-b4866e460719 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.017864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.019680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.021381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.022088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] PATH_INFO: `/v3/projects/1be38aa5522b43d9933bfadceaa15f98` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.024557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be38aa5522b43d9933bfadceaa15f98)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.027172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.038712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 884/1779] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:27.040105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.040393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.040665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.093692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:27.095683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.139944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:27.142650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be38aa5522b43d9933bfadceaa15f98', 'request_id': 'req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:27.151652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be38aa5522b43d9933bfadceaa15f98', 'request_id': 'req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:27.159027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be38aa5522b43d9933bfadceaa15f98', 'request_id': 'req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:27.180011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] The token cache is being invalidate because project 1be38aa5522b43d9933bfadceaa15f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:27.180237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:27.180930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:27.202513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 896/1780] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:26 2022] DELETE /identity/v3/projects/1be38aa5522b43d9933bfadceaa15f98 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:27.203418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.208796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.212839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 885/1781] 10.222.0.95 () {58 vars in 1058 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:27.214399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.216391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.252331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767caba-b4f8-4074-a2e5-e63bb26a2add None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.329183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:27.359729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f0c8-9d77-4779-a62d-1ecd11c8bebf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.367163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.368328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.368931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.369334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.370902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.373375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e02e-6ab9-44b8-ac2f-5dc1910b3ca5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.375263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.375933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.376215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.376484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.377145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.379602 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.411038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 886/1782] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:27.416209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.419397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.430110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 897/1783] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:27.432849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac740f0-2c55-4471-a8fb-130eee13cf8a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.433187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac740f0-2c55-4471-a8fb-130eee13cf8a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.433514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac740f0-2c55-4471-a8fb-130eee13cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.444759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371ff5-3505-43e2-94c8-c7998317d0af admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.473275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aac740f0-2c55-4471-a8fb-130eee13cf8a None None] MFA Rules not processed for user `67e79817ed9e40728f92a22053a24118`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:27.476424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aac740f0-2c55-4471-a8fb-130eee13cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.561378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.564413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.590214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.590565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.593312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.594889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 898/1784] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:27.596253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.602529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.602940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.604358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.639105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 887/1785] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:27.640005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.688899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:27.704774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.726070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 899/1786] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:27.726928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.759973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117c8b-c112-424c-8eab-60c739faf316 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.777164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.777799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.778073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.778339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.779048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.782648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.874366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 900/1787] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:27.875336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.881456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:27.888162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d057-3f37-4e59-9d13-71a89819ae9d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.893454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.894210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.894594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.894927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.896902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.899257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.904329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9125e-66b6-43d6-8728-50f6978081a0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.917448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.918549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.919210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.919873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.926273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:27.932436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 901/1788] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:27.934310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:27.943442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:27.952906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382436c-e3d0-475d-8e06-a9a902776e9f service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:27.954845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473804-a058-49f0-8957-d6fec2605c4e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:27.967053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:27.967844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.968200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.968548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] PATH_INFO: `/v3/projects/3038fe68f0b34eedad7ffa595a2ef515/users/3ba0ca5e211b4769b01bfc1e069d59f9/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:27.971285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 888/1789] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:27.975978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:27.976273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:27.976552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.011974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3038fe68f0b34eedad7ffa595a2ef515, user_id=3ba0ca5e211b4769b01bfc1e069d59f9, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.015027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.034038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:28.041788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:28.055494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 902/1790] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:27 2022] PUT /identity/v3/projects/3038fe68f0b34eedad7ffa595a2ef515/users/3ba0ca5e211b4769b01bfc1e069d59f9/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:28.055494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.063193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:28.184164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 889/1791] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:28.185140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.195889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876b32-6cb3-4eff-98d6-5cd382b79e28 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.197564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400feee-ce66-491f-9c33-6c7d196d19dd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.200955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.201667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.202008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.202355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.203120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.205116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.218084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 890/1792] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:28.220753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.221574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.221998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.223057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.224120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.234054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.236236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9699c-db54-4cf1-938d-174955bd41c6 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.243623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47c14-8d53-4cef-9e48-3bf590c565d1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.252172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.252893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.253234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.254181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.254974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.256963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eb9d8-e5d3-4621-a10d-00637a25424d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.272309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 903/1793] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:28.277631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 891/1794] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:28.278654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.279186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.279297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.279681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.279881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.280092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.308431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:28.348239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] MFA Rules not processed for user `b95e32006fdf4a14b192542c81b40149`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:28.350708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:28.352326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] MFA Rules not processed for user `3ba0ca5e211b4769b01bfc1e069d59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:28.353523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:28.552926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 904/1795] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:28.555371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.566805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 892/1796] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:28.567914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.593263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8eb00-3180-42e0-8404-8580529106f0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.595639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981cf1-3d29-423b-9d56-b15f611d5f23 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.601127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.603745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.604130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.604412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] PATH_INFO: `/v3/projects/2ed1b68603294d5386cc24434f571003/users/8321b08b3c1a49b88b650aff1999a178/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.618983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.620756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.623831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.624197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.631468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:28.632445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.634548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.642063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed1b68603294d5386cc24434f571003, user_id=8321b08b3c1a49b88b650aff1999a178, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.645586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.670280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 905/1797] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:28.670280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.686643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 893/1798] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:28 2022] PUT /identity/v3/projects/2ed1b68603294d5386cc24434f571003/users/8321b08b3c1a49b88b650aff1999a178/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:28.689728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.691866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1c5b-334e-408d-854e-815703d1bd92 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.705159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:28.814295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:28.876157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.877602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.880965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.881339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.882153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.885403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.919176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 906/1799] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:28.919356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530766e5-7473-4402-82bd-4db4ef73cf2a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.919560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.930829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6514-1c9f-4b38-9a7a-f0dda0429113 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:28.932444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.932559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.932817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.933094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.933768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.935693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3836e-477e-4747-a4b9-a97500a81cf6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.935954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:28.936573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.936927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.937200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:28.937857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:28.939999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:28.977613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 907/1800] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:28.978596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:28.985742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 894/1801] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/projects => generated 403 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:28.985742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:28.985742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:28.985742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.055805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] MFA Rules not processed for user `8321b08b3c1a49b88b650aff1999a178`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:29.057851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:29.140231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:29.146841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb336b30-3eec-49ed-a297-b91cfad0487a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.153658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 895/1802] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:29.154509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.252134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eebcd4-d0c1-4a4e-8170-ebf3ef2df667 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.264749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.265450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.265720 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.268516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] PATH_INFO: `/v3/projects/51e0088f4f7e42249b7aba76cd788e4e/users/50dc397c483d4ed1a0a8d273f1eab178/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.306920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.307577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.307925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.308167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.308924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.310823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.329548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e0088f4f7e42249b7aba76cd788e4e, user_id=50dc397c483d4ed1a0a8d273f1eab178, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.338118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.358536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 908/1803] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.360334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.379227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 896/1804] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:29 2022] PUT /identity/v3/projects/51e0088f4f7e42249b7aba76cd788e4e/users/50dc397c483d4ed1a0a8d273f1eab178/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:29.380531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.457994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:29.509830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4268-9478-40b1-9c23-bbae02647034 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.517448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.517448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.517851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.518097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.518652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.521233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.526339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ef49b-4022-407f-be70-59855f2d3299 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.535998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.536737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.537008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.537280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.540792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.545818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.555186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 897/1805] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/users => generated 308 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.556300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.568873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9df65-5886-4215-a140-23a44f31465f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.575070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.575587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.576024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.576434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.578227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.581321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a50d96-d5a7-47e1-8c16-47d03f011ceb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.611299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 909/1806] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.616322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.658477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc3b66-3e8b-4aed-b2d1-447c3079c9d7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.665775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.666055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.666453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.667076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.667953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.670457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.678303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 898/1807] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.682801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.683068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.684799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.703883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 910/1808] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.704812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.721425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba2c2-0fdc-4d3b-89c8-6e44ce01ae60 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.746238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] MFA Rules not processed for user `50dc397c483d4ed1a0a8d273f1eab178`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:29.747969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:29.841256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.842484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.842765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.843039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.844196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.846339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.848561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:29.858594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 911/1809] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:29.859530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.874350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 899/1810] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:29.874350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.874626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39748-b03b-4cc2-8db5-e0e690bcf08f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.877824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.878574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.878867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.879232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.880206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.881921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.888455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455fb99-da0c-4371-af6d-f24f4a1bd955 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.893884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 912/1811] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:29.894621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.895618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.895724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.896227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.896511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.897368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.902147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.924918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832a91-abc3-48ec-9ea4-08c348845e6c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.936169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.937777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.938147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.938886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.939614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:29.942814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:29.959857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 913/1812] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:29.961138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.964178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 900/1813] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:29.967429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:29.971565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08970-6008-41da-887d-2cc963bef2c9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:29.978603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:29.979617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:29.980186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:29.980560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] PATH_INFO: `/v3/projects/e521514656614ca28680af1c85782eaa/users/15e6bd9fa3e740318d2fd598ff71d439/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:29.997922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e622-e287-468d-8ab7-dbd4ceeff924 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.002874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.004462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.004753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.005365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.005642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e521514656614ca28680af1c85782eaa, user_id=15e6bd9fa3e740318d2fd598ff71d439, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.006099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.008531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.010379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.037950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 914/1814] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:29 2022] PUT /identity/v3/projects/e521514656614ca28680af1c85782eaa/users/15e6bd9fa3e740318d2fd598ff71d439/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.040446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.048763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 901/1815] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:29 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:30.049731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.178269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:30.199019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2464-ee8f-43dd-ae3b-9503a09ad186 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.204511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4349-e359-4acc-a4cf-2d6d5b1c92cb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.209973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.211571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.212254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.212365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.212679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.212961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.213406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.213666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.213775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] PATH_INFO: `/v3/projects/79d61e345d0f44889dc517770f9abed5/users/7d3dcce8f0f74ab1945b89ff0e1d9f35/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.215523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.234859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 902/1816] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.234859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.259203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d61e345d0f44889dc517770f9abed5, user_id=7d3dcce8f0f74ab1945b89ff0e1d9f35, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.259425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb6bb-0b12-4cc3-b7a2-4e65c076e196 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.262226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.264750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.265494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.265846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.266189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.267488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.269352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.281912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 903/1817] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.282848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.287954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 915/1818] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/79d61e345d0f44889dc517770f9abed5/users/7d3dcce8f0f74ab1945b89ff0e1d9f35/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.289132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.294739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e570-8926-40d0-bfa2-f3c7a53fce04 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.374545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.375181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.375458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.375728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.376459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.378095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.389777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8b5f-f7db-436c-95b5-12e106556b92 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.393779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 904/1819] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.395353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.399195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.399861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.400138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.400406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.401072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.403658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.406271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110526-8d33-48fe-b811-e1e8f55ad5f9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.411542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.412334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.412619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.412893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] PATH_INFO: `/v3/projects/352bdeee54e748e9851d498dfdf6780e/users/62db69e18eb24fdbae689705023d82cf/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.436752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 916/1820] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:30 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:30.437794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.437919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352bdeee54e748e9851d498dfdf6780e, user_id=62db69e18eb24fdbae689705023d82cf, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.442574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.450635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b026c-d496-44b6-9a11-81935159ede0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.455754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.456523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.456961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.457457 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] PATH_INFO: `/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7/users/c8d2b5a1b3e54f8183a42f0ffb54065c/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.461517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 905/1821] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/352bdeee54e748e9851d498dfdf6780e/users/62db69e18eb24fdbae689705023d82cf/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.471242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.479593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8045a0384d0d4882b7bc1220ae9d65d7, user_id=c8d2b5a1b3e54f8183a42f0ffb54065c, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.482478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.501441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:30.512362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 917/1822] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7/users/c8d2b5a1b3e54f8183a42f0ffb54065c/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.512362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.560234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fa8e-da0a-44a9-9d72-08f273021ac0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.579541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe039e1-1331-4fe6-8353-711ff17eb80f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.584990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.586255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.586255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.586255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] PATH_INFO: `/v3/projects/e521514656614ca28680af1c85782eaa/users/15e6bd9fa3e740318d2fd598ff71d439/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.588301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e521514656614ca28680af1c85782eaa, user_id=15e6bd9fa3e740318d2fd598ff71d439, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.590916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.602952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 918/1823] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/e521514656614ca28680af1c85782eaa/users/15e6bd9fa3e740318d2fd598ff71d439/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.603521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.618087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:30.632433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.633498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.633837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.634319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.635229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.636979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24f16d-c14c-46fa-be55-9804bb27c1e9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.649311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 906/1824] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.650666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.650917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.651337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.684692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] MFA Rules not processed for user `62db69e18eb24fdbae689705023d82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:30.686187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:30.691268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114270-733d-49b1-b759-a4c599562b34 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.697609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.698393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.698682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.699099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.699973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.701685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.720034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 919/1825] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.720034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.734414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48163d6-8e09-415e-99f4-55d8dbb75fec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.745212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.745908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.746190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.746463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.747177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.748823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.760712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 920/1826] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.761615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.783986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e57f3-8882-4847-b1a0-0e80b4d30365 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.791342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 907/1827] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:30.792115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.797892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.798967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.801405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.801607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] PATH_INFO: `/v3/projects/79d61e345d0f44889dc517770f9abed5/users/7d3dcce8f0f74ab1945b89ff0e1d9f35/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.806273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d61e345d0f44889dc517770f9abed5, user_id=7d3dcce8f0f74ab1945b89ff0e1d9f35, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.808757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87e46-d8d1-43ac-a10e-5059a8406cdc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.809616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.818398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.819044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.819374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.819696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.820651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.831745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 921/1828] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/79d61e345d0f44889dc517770f9abed5/users/7d3dcce8f0f74ab1945b89ff0e1d9f35/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:30.832036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.832236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.850256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 908/1829] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:30.851207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:30.873465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f197-b95f-456f-b51c-947d7b372a81 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.961538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c8eef-28a5-4086-8b04-262b67bb4419 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:30.971306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.973840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.974702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.974990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] PATH_INFO: `/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7/users/c8d2b5a1b3e54f8183a42f0ffb54065c/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.981224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8045a0384d0d4882b7bc1220ae9d65d7, user_id=c8d2b5a1b3e54f8183a42f0ffb54065c, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.985726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:30.988071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:30.988519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:30.988856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:30.990039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:30.990377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef5c4a-028b-4a82-a9d3-097f50089c4a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:30.995255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:31.005650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:31.027968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 922/1830] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:30 2022] PUT /identity/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7/users/c8d2b5a1b3e54f8183a42f0ffb54065c/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:31.029455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88606a8-dac8-4a85-93ce-9f718bacc1c1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.029744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88606a8-dac8-4a85-93ce-9f718bacc1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.030036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88606a8-dac8-4a85-93ce-9f718bacc1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.065496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 909/1831] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:30 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:31.068385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:31.098491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c88606a8-dac8-4a85-93ce-9f718bacc1c1 None None] MFA Rules not processed for user `7d3dcce8f0f74ab1945b89ff0e1d9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:31.100616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c88606a8-dac8-4a85-93ce-9f718bacc1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:31.188240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:31.204430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578a29-ac17-427e-9732-6af2b8591b88 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:31.212191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:31.213295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.213755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.214257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] PATH_INFO: `/v3/projects/f657a4260d9349649bf0357db6de29bc/users/d2f4a45802c64e6384f5c5770bcda7ed/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.218136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 923/1832] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:31.220151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.220830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.221315 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.239332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f657a4260d9349649bf0357db6de29bc, user_id=d2f4a45802c64e6384f5c5770bcda7ed, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:31.243917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:31.287342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 910/1833] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:31 2022] PUT /identity/v3/projects/f657a4260d9349649bf0357db6de29bc/users/d2f4a45802c64e6384f5c5770bcda7ed/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:31.290272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:31.298388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] MFA Rules not processed for user `c8d2b5a1b3e54f8183a42f0ffb54065c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:31.301108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:31.442413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108db3-e429-4454-bb8d-d63d78892da7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:31.451253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:31.452447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.452987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.453425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.454648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:31.458873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ee685-95ac-480a-8bc4-fda0b0548d55 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:31.503269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 924/1834] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:31.504705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:31.511053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:31.587597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 911/1835] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:31 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:31.600275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036949e-57f2-427c-a473-540ba3861ecd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.600565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036949e-57f2-427c-a473-540ba3861ecd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.600848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036949e-57f2-427c-a473-540ba3861ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.689361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7336d5d-f48d-4c32-9f63-26eeed043092 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:31.694789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:31.695434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.695714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.696025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.724733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:31.729733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f036949e-57f2-427c-a473-540ba3861ecd None None] MFA Rules not processed for user `d2f4a45802c64e6384f5c5770bcda7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:31.730764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f036949e-57f2-427c-a473-540ba3861ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:31.862960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:31.872397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:31.885636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 925/1836] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:31.886820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:31.888456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:31.911189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157cda-ec6c-4b21-9bd8-8cf0c13c1eb5 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:31.917248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:31.918054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.918470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.918871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.932256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:31.933988 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:31.949923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 926/1837] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:31.951163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:31.979536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc80a12-2c4e-4119-82ec-0b0688c7e25b service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:31.991294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:31.992288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 912/1838] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:31.993706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.995300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.995573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:31.997643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:31.997801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:31.998020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:31.998294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.004662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.043393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 927/1839] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:32.044291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.075098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa94f-0b8d-4923-b1c6-8d8579af5f47 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.099737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.100411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.100695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.100972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.102615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.105355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.165454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:32.166969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:32.174480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 928/1840] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:32 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:32.178855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.225333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:32.255727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a1a2-6174-40b7-ab88-8d085c3207cd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.260117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.260859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.261256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.261529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.325608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 913/1841] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:32.326622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.367497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.369116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.393312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 929/1842] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:32.395911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.467491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be48d8f-3122-4936-90e7-12995f7e7774 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.481058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.482018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.483017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.483017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] PATH_INFO: `/v3/projects/7282aa79afad43bb8fd97d795565bf3d/users/58d78dcb8f404034840315941e61c494/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.490125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:32.532243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282aa79afad43bb8fd97d795565bf3d, user_id=58d78dcb8f404034840315941e61c494, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.542705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.576701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 914/1843] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:32 2022] PUT /identity/v3/projects/7282aa79afad43bb8fd97d795565bf3d/users/58d78dcb8f404034840315941e61c494/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:32.576701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.576980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef8-d1fb-4e70-82d0-3c427cefccc3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.589368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:32.783756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.784740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.784740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.785010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.786138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.788362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.835286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 930/1844] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:32 2022] POST /identity/v3/users => generated 299 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:32.836508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.845597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60399-523f-4324-9595-749ea1939e17 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.854626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.855381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.855667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.856084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.860091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28fcc3-ab9d-420f-818c-9bf01932a823 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.869433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.870074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.870370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.870641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.871341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.872994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.904640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 931/1845] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:32.904640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.908002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:32.924023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3d2c-1892-4290-9480-a128f203ca20 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:32.933616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:32.934258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:32.934536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:32.934798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:32.935497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.937121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.964373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 932/1846] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:32.965075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:32.979594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:32.982806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:32.995406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812134-cfdc-44be-9bf8-59eb18916650 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:33.017263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:33.017957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.018240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.018512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] PATH_INFO: `/v3/projects/7282aa79afad43bb8fd97d795565bf3d/users/58d78dcb8f404034840315941e61c494/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.022363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282aa79afad43bb8fd97d795565bf3d, user_id=58d78dcb8f404034840315941e61c494, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:33.023868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 915/1847] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:04:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:33.024765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:33.026687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb1d0d-e483-4ed9-8776-a45cae2b2b65 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:33.050114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53caf8-4a46-4019-8baf-4f758b50c8d3 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:33.051875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 933/1848] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:32 2022] PUT /identity/v3/projects/7282aa79afad43bb8fd97d795565bf3d/users/58d78dcb8f404034840315941e61c494/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:33.064571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.065224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.065769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.149005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] MFA Rules not processed for user `58d78dcb8f404034840315941e61c494`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:33.151195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:33.197690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:33.198516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.198779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.199054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] PATH_INFO: `/v3/projects/ef552966e80d43f2b2f91c1940557030/users/035b446006634d57b941626970a4bf27/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.242956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef552966e80d43f2b2f91c1940557030, user_id=035b446006634d57b941626970a4bf27, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:33.252303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:33.282853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 916/1849] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:33 2022] PUT /identity/v3/projects/ef552966e80d43f2b2f91c1940557030/users/035b446006634d57b941626970a4bf27/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:33.288448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:33.352523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 934/1850] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:33.369501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:33.428584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:33.462543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd72c-c722-4a5c-89cc-50432efd7c13 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:33.469559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:33.470559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.471079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.471813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.473612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:33.476185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:33.493334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 917/1851] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:33.499520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:33.566209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb45db2-1040-4d92-be08-5ec168847a95 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:33.569921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d4f8-556b-489a-b3d0-ba0748d90ab9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:33.583515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:33.584254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.584533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.586402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] PATH_INFO: `/v3/projects/ef552966e80d43f2b2f91c1940557030/users/035b446006634d57b941626970a4bf27/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.598650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef552966e80d43f2b2f91c1940557030, user_id=035b446006634d57b941626970a4bf27, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:33.601378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728e2b-8370-47cf-bea6-80a17d9d6e2a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:33.657967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 918/1852] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:33 2022] PUT /identity/v3/projects/ef552966e80d43f2b2f91c1940557030/users/035b446006634d57b941626970a4bf27/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:33.657967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4a8e-3c3b-4e39-a747-774304a7446f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.658767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4a8e-3c3b-4e39-a747-774304a7446f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.659043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4a8e-3c3b-4e39-a747-774304a7446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.716539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bfbd4a8e-3c3b-4e39-a747-774304a7446f None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:33.717782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bfbd4a8e-3c3b-4e39-a747-774304a7446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:33.749323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:33.751252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.756630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.756942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.839175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:33.917123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 919/1853] 10.222.0.97 () {58 vars in 1015 bytes} [Fri Aug 5 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:33.921409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:33.921713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:33.925549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:33.956010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:33.958978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607565-6bc0-415e-8140-d13abfe809bc service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:33.993000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] MFA Rules not processed for user `035b446006634d57b941626970a4bf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:33.995941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:34.013126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 935/1854] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:34.015415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:34.020604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:34.021239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:34.118458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] MFA Rules not processed for user `15e6bd9fa3e740318d2fd598ff71d439`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:34.122482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:34.188970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 920/1855] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:34.189922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:34.192462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:34.230284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8174f4b-3a2b-4f71-a798-d7d6e5530e46 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:34.240784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:34.241661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:34.241947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:34.242220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:34.262661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:34.266241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:34.294075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 921/1856] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:34.348536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:34.469219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 936/1857] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:34.523703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad39d9-be7c-43cd-bbca-8a5bd12587ba service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:34.539740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:34.543014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:34.544297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:34.544958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:34.621862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:34.630816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b43c-1a0d-431a-a54c-85e40e541564 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:34.676253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 922/1858] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:36.900076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:36.919600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35163a-b3e0-4fbb-909e-fd7b193c84f4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:36.926630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:36.927535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:36.928033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:36.928476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:36.944464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:37.114446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:37.116319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57b72-48b8-4019-84d1-e3c096c3e07d service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:37.128156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 937/1859] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:37.557578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf69d-2157-4c24-9f25-cc85b3c6e453 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:37.558305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf69d-2157-4c24-9f25-cc85b3c6e453 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:37.558698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf69d-2157-4c24-9f25-cc85b3c6e453 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:37.562002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 923/1860] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:04:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:37.638224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:37.638683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:37.639058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:37.701259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:37.714352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:37.961040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 938/1861] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:38.059823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba494e-a329-4b13-9c78-1afe9f317804 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:38.061874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba494e-a329-4b13-9c78-1afe9f317804 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:38.065707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba494e-a329-4b13-9c78-1afe9f317804 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:38.076508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 924/1862] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:04:38 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:38.087651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:38.126206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:38.126706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:38.129341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:38.190101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ca09-66e8-4a69-b408-b004e73082c8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:38.201475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:38.204016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:38.204827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:38.207594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:38.223576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:38.227642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:38.234512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:38.241565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:38.294669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 939/1863] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:38.355268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:38.400372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 925/1864] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:38.607062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:38.622306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f23ccc-dd84-4f54-9a1b-e979d7c3b0ab service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:38.631718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:38.632236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:38.632546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:38.632833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:38.841061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:38.842509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fb4db-208b-4446-b0d9-233c54df2263 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:38.871341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 940/1865] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:39.003410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:39.005802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:39.037694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870263-b1bf-48c0-9868-4e2c755bb064 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:39.055660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:39.056785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:39.057265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:39.057734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:39.081908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:39.084594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa490e5-c90c-4111-87bd-6d6d55a5f2dd service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:39.118491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 926/1866] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:39.806960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af17ac-5b8d-4553-88b1-4e35c130643b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:39.807546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af17ac-5b8d-4553-88b1-4e35c130643b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:39.807546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af17ac-5b8d-4553-88b1-4e35c130643b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:39.809185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 941/1867] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:40.001485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:40.001997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:40.002693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:40.053100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:40.061096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:40.087376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af17ac-5b8d-4553-88b1-4e35c130643b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:40.104528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 927/1868] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:40.167211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:40.246705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af17ac-5b8d-4553-88b1-4e35c130643b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:40.253080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:40.255229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:40.256080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:40.256618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] PATH_INFO: `/v3/users/8321b08b3c1a49b88b650aff1999a178` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:40.258254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8321b08b3c1a49b88b650aff1999a178)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:40.260588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:40.304190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:40.306236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:40.347055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4129b-2ba4-48cd-82af-7c7ec268febb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:40.367966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:40.370351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:40.370635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:40.370909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:40.386099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8321b08b3c1a49b88b650aff1999a178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:40.387880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8321b08b3c1a49b88b650aff1999a178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:40.400014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:40.401665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9b91f-10c1-415e-8d0d-1ac4559e65c2 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:40.436750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8321b08b3c1a49b88b650aff1999a178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:40.446097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 928/1869] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:40.461892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8321b08b3c1a49b88b650aff1999a178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:40.486084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8321b08b3c1a49b88b650aff1999a178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:40.501761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 942/1870] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:40 2022] DELETE /identity/v3/users/8321b08b3c1a49b88b650aff1999a178 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:40.510593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:40.511351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:40.512250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:40.592275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:40.593887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:40.799930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 929/1871] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:40.863983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:40.865618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:40.872522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:40.875237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:40.908553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb106ad-2aa5-4e4f-a6ab-4b7e05885115 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:40.929710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:40.930767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:40.931053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:40.931323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] PATH_INFO: `/v3/users/62db69e18eb24fdbae689705023d82cf` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:40.934719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] RBAC: Authorizing `identity:delete_user(user_id=62db69e18eb24fdbae689705023d82cf)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:40.936346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:41.009624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131c1c5-1106-4223-b1c9-b50f76fcde6d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:41.037781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:41.037781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.037781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.051285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.085631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:41.089573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbddf-224e-4784-8ab1-a133e4806483 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:41.096311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62db69e18eb24fdbae689705023d82cf'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:41.114034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62db69e18eb24fdbae689705023d82cf'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:41.117348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62db69e18eb24fdbae689705023d82cf'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:41.123503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 943/1872] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:41.139643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62db69e18eb24fdbae689705023d82cf'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:41.151583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62db69e18eb24fdbae689705023d82cf'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:41.165367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 930/1873] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:40 2022] DELETE /identity/v3/users/62db69e18eb24fdbae689705023d82cf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:41.170296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887fea-5cbb-4a13-8bc4-81b1d2242a9f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.171900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887fea-5cbb-4a13-8bc4-81b1d2242a9f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.172405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887fea-5cbb-4a13-8bc4-81b1d2242a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.227495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-52887fea-5cbb-4a13-8bc4-81b1d2242a9f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:41.228993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-52887fea-5cbb-4a13-8bc4-81b1d2242a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:41.321511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:41.350556 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 944/1874] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:41.378288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:41.380908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:41.492531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:41.564269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5e00-ea90-46b2-8ab3-46ea0369daea admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:41.568732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:41.569378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.569883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.570098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.590237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:41.592305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721f11-bb40-41f5-8cc0-e14274d9d2f8 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:41.616861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 931/1875] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:41.760819 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.761487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.761487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.763399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 945/1876] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:41.771628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.772053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.772429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.828066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] MFA Rules not processed for user `b3d6df032d6640deaac623bce31af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:41.829304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:41.896682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:41.898696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:41.945853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4f179-1ffd-4673-a615-d1be1ff3e9eb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:41.973554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 932/1877] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:41.974124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:41.975080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:41.975426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:41.975711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] PATH_INFO: `/v3/users/b95e32006fdf4a14b192542c81b40149` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:41.981227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95e32006fdf4a14b192542c81b40149)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:41.983358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:42.016235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:42.027347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:42.115384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e15b-d54a-4cc8-9c02-f2bb071f138c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:42.141851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:42.142794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95e32006fdf4a14b192542c81b40149'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.143074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:42.143920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:42.145012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:42.147720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95e32006fdf4a14b192542c81b40149'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.157205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:42.188311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95e32006fdf4a14b192542c81b40149'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.210126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95e32006fdf4a14b192542c81b40149'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.214448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:42.223113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:42.227678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95e32006fdf4a14b192542c81b40149'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.264068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 946/1878] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:41 2022] DELETE /identity/v3/users/b95e32006fdf4a14b192542c81b40149 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:42.271754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 933/1879] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:42.535677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:42.537227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:42.694603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5177dba-8eb5-420f-8c4c-f946b80aa9c6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:42.714680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:42.715438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:42.715836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:42.724574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] PATH_INFO: `/v3/projects/352bdeee54e748e9851d498dfdf6780e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:42.732516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=352bdeee54e748e9851d498dfdf6780e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:42.739901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:42.849732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352bdeee54e748e9851d498dfdf6780e', 'request_id': 'req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.871710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:42.873888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:42.885148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352bdeee54e748e9851d498dfdf6780e', 'request_id': 'req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.904443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:42.907597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352bdeee54e748e9851d498dfdf6780e', 'request_id': 'req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.912462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023bf25-5fd7-4e9e-801b-5fe3ef67883e service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:42.970066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] The token cache is being invalidate because project 352bdeee54e748e9851d498dfdf6780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:42.970650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.971418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:42.981528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 947/1880] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:42 2022] DELETE /identity/v3/projects/352bdeee54e748e9851d498dfdf6780e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:42.985242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:42.990149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:43.117741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:43.119137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:43.119657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:43.120127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] PATH_INFO: `/v3/projects/6634f8d7489a42d4b777f1d4bb892a9c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:43.121761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6634f8d7489a42d4b777f1d4bb892a9c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:43.124808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:43.186477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288a03-5705-4f51-a8ad-d065fe1ea1ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:43.194170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:43.195477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:43.196096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:43.196631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] PATH_INFO: `/v3/users/58d78dcb8f404034840315941e61c494` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:43.198542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d78dcb8f404034840315941e61c494)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:43.201335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:43.299062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d78dcb8f404034840315941e61c494'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.301475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6634f8d7489a42d4b777f1d4bb892a9c', 'request_id': 'req-dcab1b3d-a24f-4cda-8964-0368deb39098'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.301666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d78dcb8f404034840315941e61c494'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.322076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6634f8d7489a42d4b777f1d4bb892a9c', 'request_id': 'req-dcab1b3d-a24f-4cda-8964-0368deb39098'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.327998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:43.337050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6634f8d7489a42d4b777f1d4bb892a9c', 'request_id': 'req-dcab1b3d-a24f-4cda-8964-0368deb39098'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.346818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d78dcb8f404034840315941e61c494'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.359465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] The token cache is being invalidate because project 6634f8d7489a42d4b777f1d4bb892a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:43.362569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.364608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.365579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d78dcb8f404034840315941e61c494'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.368017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 934/1881] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:42 2022] DELETE /identity/v3/projects/6634f8d7489a42d4b777f1d4bb892a9c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:43.372644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:43.380607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:43.382431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d78dcb8f404034840315941e61c494'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.402882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 948/1882] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:42 2022] DELETE /identity/v3/users/58d78dcb8f404034840315941e61c494 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:43.443118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:43.444796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:43.545126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1b3d-a24f-4cda-8964-0368deb39098 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:43.553940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae306c-b9e7-4d98-94f8-77f812063275 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:43.565842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:43.567564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:43.567905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:43.568327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:43.570673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:43.626266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:43.682575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:43.685297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:43.685672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:43.686019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] PATH_INFO: `/v3/users/15e6bd9fa3e740318d2fd598ff71d439` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:43.688947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e6bd9fa3e740318d2fd598ff71d439)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:43.693975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:43.728349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:43.730641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:43.746686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 949/1883] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:43.787047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e6bd9fa3e740318d2fd598ff71d439'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.798542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e6bd9fa3e740318d2fd598ff71d439'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.799552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e6bd9fa3e740318d2fd598ff71d439'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.816478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e6bd9fa3e740318d2fd598ff71d439'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.835159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:43.836405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e6bd9fa3e740318d2fd598ff71d439'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:43.836868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:43.856802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 935/1884] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:43 2022] DELETE /identity/v3/users/15e6bd9fa3e740318d2fd598ff71d439 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:43.866693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3aef5-1936-4680-9da0-7322d7bca096 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:44.060720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:44.062041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:44.062331 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:44.063374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] PATH_INFO: `/v3/projects/2ed1b68603294d5386cc24434f571003` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:44.066304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed1b68603294d5386cc24434f571003)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:44.068954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:44.165162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed1b68603294d5386cc24434f571003', 'request_id': 'req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.180303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed1b68603294d5386cc24434f571003', 'request_id': 'req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.195184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed1b68603294d5386cc24434f571003', 'request_id': 'req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.220595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] The token cache is being invalidate because project 2ed1b68603294d5386cc24434f571003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:44.220933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.223437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.229538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:44.231173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:44.232682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 950/1885] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:43 2022] DELETE /identity/v3/projects/2ed1b68603294d5386cc24434f571003 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:44.249048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652d93-1745-4f68-8a98-992a43ca5549 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:44.262755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:44.335058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:44.336017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:44.336347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:44.336659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] PATH_INFO: `/v3/users/c8d2b5a1b3e54f8183a42f0ffb54065c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:44.338956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d2b5a1b3e54f8183a42f0ffb54065c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:44.341073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:44.428381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d2b5a1b3e54f8183a42f0ffb54065c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.436033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d2b5a1b3e54f8183a42f0ffb54065c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.436829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d2b5a1b3e54f8183a42f0ffb54065c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.452054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d2b5a1b3e54f8183a42f0ffb54065c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.465723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d2b5a1b3e54f8183a42f0ffb54065c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:44.476349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 936/1886] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:44 2022] DELETE /identity/v3/users/c8d2b5a1b3e54f8183a42f0ffb54065c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:44.741116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:44.743588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:44.813629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0996b0-00d0-4fa2-aad4-2c3085d59d53 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:44.825874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:44.827289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:44.911841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:44.926409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:44.928172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:44.928658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:44.929329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] PATH_INFO: `/v3/projects/7282aa79afad43bb8fd97d795565bf3d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:44.931159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7282aa79afad43bb8fd97d795565bf3d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:44.934038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:44.971116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2873-0c61-497b-a6ef-a0f6bee07692 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:44.982174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:44.983034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:44.985420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:44.985420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] PATH_INFO: `/v3/projects/e521514656614ca28680af1c85782eaa` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:44.987885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e521514656614ca28680af1c85782eaa)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:44.993080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.028786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7282aa79afad43bb8fd97d795565bf3d', 'request_id': 'req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.037496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7282aa79afad43bb8fd97d795565bf3d', 'request_id': 'req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.045467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7282aa79afad43bb8fd97d795565bf3d', 'request_id': 'req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.068179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] The token cache is being invalidate because project 7282aa79afad43bb8fd97d795565bf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:45.068823 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.069246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fa7c2cb5-30ac-49f8-9977-381950e8d6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.069944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:45.078596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 951/1887] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:44 2022] DELETE /identity/v3/projects/7282aa79afad43bb8fd97d795565bf3d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:45.083102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cf078-4633-4e2a-9335-eb17181eb4a0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.087243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cf078-4633-4e2a-9335-eb17181eb4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.087672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cf078-4633-4e2a-9335-eb17181eb4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.109575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e521514656614ca28680af1c85782eaa', 'request_id': 'req-1a988e76-1912-4dc1-b67d-00d1bd219bff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.125334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e521514656614ca28680af1c85782eaa', 'request_id': 'req-1a988e76-1912-4dc1-b67d-00d1bd219bff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.137062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e521514656614ca28680af1c85782eaa', 'request_id': 'req-1a988e76-1912-4dc1-b67d-00d1bd219bff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.140493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f54cf078-4633-4e2a-9335-eb17181eb4a0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.141816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f54cf078-4633-4e2a-9335-eb17181eb4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.155659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] The token cache is being invalidate because project e521514656614ca28680af1c85782eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:45.155970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.156623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1a988e76-1912-4dc1-b67d-00d1bd219bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.162376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 937/1888] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:44 2022] DELETE /identity/v3/projects/e521514656614ca28680af1c85782eaa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:45.164771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573ae1-da5c-4888-af90-08f7d5873e4b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.165051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573ae1-da5c-4888-af90-08f7d5873e4b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.165318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573ae1-da5c-4888-af90-08f7d5873e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.191677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-52573ae1-da5c-4888-af90-08f7d5873e4b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.193095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-52573ae1-da5c-4888-af90-08f7d5873e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.216992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 952/1889] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.225579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.226175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.226513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.248927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.250571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.265006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 953/1890] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.269984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.275839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 938/1891] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.280691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.281007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.281261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.283038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb58d76-179d-4dad-b8d2-541e134edf25 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.289082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.289822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.290220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.290588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.291410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:45.291825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.293882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.312042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 954/1892] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:45.314376 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.315123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.316812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.326143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 939/1893] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:45.328053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8eb7-96ae-40ad-a151-bba4463965dc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.333902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.334630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.334806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.335078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.336107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.336986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.338023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.348480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5955017-ab3a-4911-9fc3-c9a018278b9d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.354203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.355091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.355464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.355875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.356684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:45.357113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.358887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.380967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 955/1894] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:45.382211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.383976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 940/1895] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:45.385455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.388743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.399038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5ffa-d57f-4a4f-a2d9-1de27d22862c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.458148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:45.474876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.475562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.475907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.476256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.477118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.479055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.487615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23880-2ee2-402c-86e0-4c49f0061540 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.494992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.495764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.496699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.496699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] PATH_INFO: `/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.498038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8045a0384d0d4882b7bc1220ae9d65d7)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.500008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.504406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 941/1896] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:45.508983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.520318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf455bc-a98e-4d5c-8581-ec0aa363f05a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.525157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.525782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.526058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.526332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.526994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.528975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.559377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8045a0384d0d4882b7bc1220ae9d65d7', 'request_id': 'req-73ed6729-1572-4006-8f9f-21da94edb758'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.564827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 942/1897] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:45.565678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.566949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8045a0384d0d4882b7bc1220ae9d65d7', 'request_id': 'req-73ed6729-1572-4006-8f9f-21da94edb758'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.567971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.574613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8045a0384d0d4882b7bc1220ae9d65d7', 'request_id': 'req-73ed6729-1572-4006-8f9f-21da94edb758'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.587651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] The token cache is being invalidate because project 8045a0384d0d4882b7bc1220ae9d65d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:45.587966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.588625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.590177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 956/1898] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:45 2022] DELETE /identity/v3/projects/8045a0384d0d4882b7bc1220ae9d65d7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:45.594239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.594342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:45.594597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.649523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c02a7-80ee-4bdf-a00c-0c5662ba0336 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.654334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.654984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.655269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.655543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] PATH_INFO: `/v3/users/3ba0ca5e211b4769b01bfc1e069d59f9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.656758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba0ca5e211b4769b01bfc1e069d59f9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.658690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.662230 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed6729-1572-4006-8f9f-21da94edb758 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.666858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.667739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.668415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.668415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.668974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.670565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.681860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 957/1899] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:45.682912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.684713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.698801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637d86-e9bd-4f41-97bd-996844fd5a71 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.703708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.704336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.704694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.708236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.709462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.712836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa030ba-8eee-4ee8-89a7-5c934372112f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.719718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba0ca5e211b4769b01bfc1e069d59f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.729478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba0ca5e211b4769b01bfc1e069d59f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.730415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba0ca5e211b4769b01bfc1e069d59f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.743052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 958/1900] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/users => generated 278 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:45.745585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba0ca5e211b4769b01bfc1e069d59f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.746565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.746854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.747129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.755707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba0ca5e211b4769b01bfc1e069d59f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:45.764609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 943/1901] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:45 2022] DELETE /identity/v3/users/3ba0ca5e211b4769b01bfc1e069d59f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:45.765737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.767523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.773008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.774261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.825099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:45.848025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 959/1902] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.856082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.857585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.857990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9969e-ef4a-445c-90f6-09b446344765 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.863867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.864761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.865188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.866002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.867517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.869375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f67cb-c804-4093-9086-5b6d48b6a9d7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.873932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75060fa6-67d7-4b74-a397-4884e37c3926 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.886439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 944/1903] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:45.887466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.888157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.888435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.888647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.888852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.889048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.889389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.889633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.900507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a930aa-2317-40d4-a5c5-943bd3b944fd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.910590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.912022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.912406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 960/1904] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:45.913909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.914141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.914414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.922288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 945/1905] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.927183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.935950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:45.937416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:45.937817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f871cd5-8561-48b9-b700-12da11e2ee4e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.946244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 961/1906] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:45.948051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.948849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.949791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.950077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.950351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] PATH_INFO: `/v3/projects/9a6627cb6c6b4bc7bac7e11e7bde387b/users/d700e537bd0b471f816558a14e2e2a6a/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.959863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df6be-071f-41d8-8a89-853b1dabf151 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:45.964699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:45.965316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:45.965591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:45.965863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:45.966558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.968210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.968838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6627cb6c6b4bc7bac7e11e7bde387b, user_id=d700e537bd0b471f816558a14e2e2a6a, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:45.972271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:45.976079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:45.980077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 962/1907] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:45.980801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:45.982712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.003030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 946/1908] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:45 2022] PUT /identity/v3/projects/9a6627cb6c6b4bc7bac7e11e7bde387b/users/d700e537bd0b471f816558a14e2e2a6a/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:46.003030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.059591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83ffa-5fd7-4e74-ac01-caa3a1a3f83e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.065708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e97ab-86a7-40f2-bcf4-eedaab026c94 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.071106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.071651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.071973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.072273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.072970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:46.073274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.074871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.088162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 947/1909] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:46.089122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.100950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa058-a88f-4e1f-a01b-3c9e9490e166 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.105842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.106560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.106803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.107077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] PATH_INFO: `/v3/projects/acdc655640bb401ea7af08659250d536/users/c63e749a3c6442a184ebffafadbc9ccf/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.109850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.110465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.110882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.111004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.120809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.123362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb902d-3312-4400-8789-6ba266b153c6 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.123471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdc655640bb401ea7af08659250d536, user_id=c63e749a3c6442a184ebffafadbc9ccf, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.126117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.135096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 963/1910] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:46.136547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0d6d-8125-4830-abae-e2260302331a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.137063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0d6d-8125-4830-abae-e2260302331a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.137175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0d6d-8125-4830-abae-e2260302331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.147349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 948/1911] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:46 2022] PUT /identity/v3/projects/acdc655640bb401ea7af08659250d536/users/c63e749a3c6442a184ebffafadbc9ccf/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:46.157167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.172569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6eda0d6d-8125-4830-abae-e2260302331a None None] MFA Rules not processed for user `d700e537bd0b471f816558a14e2e2a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:46.176031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6eda0d6d-8125-4830-abae-e2260302331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.268891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51a5a-1ab1-4558-b97d-cf7c14f52235 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.275806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.276535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.277061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.277061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.277766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.279425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 964/1912] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:46.279826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.281504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.281948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.282234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.311277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:46.321741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 949/1913] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/projects => generated 409 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.322753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.327891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] MFA Rules not processed for user `c63e749a3c6442a184ebffafadbc9ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:46.327891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.403816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:46.423891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 965/1914] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:46.423891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.424166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b6e09-1561-4cd4-8e32-c8a3aef30805 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.430725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.431447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.432154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.432154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.434757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.436823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.437525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4f063-c1f9-42f7-b81b-d027f881d305 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.445156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.445792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.451753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.451753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.451753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.451753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.471421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 950/1915] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.476099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.490491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 966/1916] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/users => generated 305 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.491955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.502636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af275d1-25f3-413e-b83f-2aab96b506e5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.562488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9424a-9666-4d39-82c2-031816ddc923 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.570358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.571015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.571542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.571852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.573047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.575033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.589144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.589960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.590360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.590873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.591937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.594161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.608882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 951/1917] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.608882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.626276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 967/1918] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.626276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.627762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.643252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d801-ebec-4277-aaa4-c1a958480ad7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.698740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9fc6-0d1b-4d56-b3b4-2cb7481789d8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.708724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.710240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.710721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.711002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.711718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.714219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.733026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 952/1919] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:46.733857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.742820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.743569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.743888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.744164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] PATH_INFO: `/v3/projects/3038fe68f0b34eedad7ffa595a2ef515` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.745353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3038fe68f0b34eedad7ffa595a2ef515)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.746375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719b45-2b49-41a2-b677-50e3fd2be938 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.747436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.751030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.751707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.752152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.752425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.753143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.755977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.765056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:46.781675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 953/1920] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:46 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:46.782410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.793258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e5c-4095-4881-a925-e40ecd849bb1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.808158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3038fe68f0b34eedad7ffa595a2ef515', 'request_id': 'req-4591033b-6d49-4f37-bbb0-0873a5c23fae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.815801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3038fe68f0b34eedad7ffa595a2ef515', 'request_id': 'req-4591033b-6d49-4f37-bbb0-0873a5c23fae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.826726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3038fe68f0b34eedad7ffa595a2ef515', 'request_id': 'req-4591033b-6d49-4f37-bbb0-0873a5c23fae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.837794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:46.842385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] The token cache is being invalidate because project 3038fe68f0b34eedad7ffa595a2ef515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:46.842758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.843595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.845398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 968/1921] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:46 2022] DELETE /identity/v3/projects/3038fe68f0b34eedad7ffa595a2ef515 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:46.846301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.847896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.859353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.860027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.860300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.860572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.861269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.862834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.874366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 954/1922] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:46.875191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.876884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.889645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b91b7-704c-4b4a-acfc-c04cb907f2fc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.897471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.898328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.898328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.898626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.899286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.900905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.918391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 955/1923] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:46.918391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.918619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591033b-6d49-4f37-bbb0-0873a5c23fae admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.920339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.922413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.923068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.923336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.923603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] PATH_INFO: `/v3/users/50dc397c483d4ed1a0a8d273f1eab178` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.924811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50dc397c483d4ed1a0a8d273f1eab178)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.927335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.937311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a492a8-4bea-4e2f-b8f3-17fa9923d6cb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.944018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.944652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.944936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.945215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.945958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.947557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:46.958646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 956/1924] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:46.963661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:46.965632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:46.979195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ed41f-fc4c-4a98-bb50-c9fbb53cd2f7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:46.983750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50dc397c483d4ed1a0a8d273f1eab178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.984231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:46.984579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50dc397c483d4ed1a0a8d273f1eab178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:46.984872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:46.985153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:46.985423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] PATH_INFO: `/v3/users/7d3dcce8f0f74ab1945b89ff0e1d9f35` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:46.989778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3dcce8f0f74ab1945b89ff0e1d9f35)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:46.991849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.001786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50dc397c483d4ed1a0a8d273f1eab178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.010192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50dc397c483d4ed1a0a8d273f1eab178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.020405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50dc397c483d4ed1a0a8d273f1eab178'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.033660 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 969/1925] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:46 2022] DELETE /identity/v3/users/50dc397c483d4ed1a0a8d273f1eab178 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.034574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.037124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.046742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3dcce8f0f74ab1945b89ff0e1d9f35'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.056698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3dcce8f0f74ab1945b89ff0e1d9f35'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.057445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3dcce8f0f74ab1945b89ff0e1d9f35'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.071469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.074538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3dcce8f0f74ab1945b89ff0e1d9f35'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.085682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3dcce8f0f74ab1945b89ff0e1d9f35'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.094101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 957/1926] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:46 2022] DELETE /identity/v3/users/7d3dcce8f0f74ab1945b89ff0e1d9f35 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.095125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.096830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.130653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693b4e-4a70-43a5-9e48-651539c7fe4b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.194089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610372f-ac31-45dd-906b-70091b351895 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.200426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.201320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.201603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.202029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] PATH_INFO: `/v3/projects/a72cfaa1322b4fb38799517f82365a0a/users/633872ea99e2473c940f2714ca8a95b8/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.211491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.212121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.212473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.212794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] PATH_INFO: `/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe/users/443c5358357e4ef9b2afc5f81bead5d8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.235499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9fba3c4c914edf9c9c3632c953a0fe, user_id=443c5358357e4ef9b2afc5f81bead5d8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.238991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.242596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72cfaa1322b4fb38799517f82365a0a, user_id=633872ea99e2473c940f2714ca8a95b8, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.245325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23931f-a397-430c-991f-916a07eacbf9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.263170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 970/1927] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:47 2022] PUT /identity/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe/users/443c5358357e4ef9b2afc5f81bead5d8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.264273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.266262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.270696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 958/1928] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:47 2022] PUT /identity/v3/projects/a72cfaa1322b4fb38799517f82365a0a/users/633872ea99e2473c940f2714ca8a95b8/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.271436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.271436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.271608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.303678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:47.304956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.309846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.366486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c88e-6166-417e-82c5-333c1afb9979 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.379754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 959/1929] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:47.381398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.382713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.397844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b025a66-63ef-4e29-a4fc-9b7d15525865 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.403088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.403729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.404757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.405039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.405744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.407432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a41d9-7776-4fc3-808e-f3745ec566f7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.422632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 960/1930] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:47.428471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.428794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.429213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.464062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.464767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.465031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.465300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] PATH_INFO: `/v3/projects/417f7260b8ce4928bdd3221d0431b714/users/a0aa795a8bb7465c8ec41329f64dcf30/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.465494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] MFA Rules not processed for user `633872ea99e2473c940f2714ca8a95b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:47.466901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.468154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.485340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f7260b8ce4928bdd3221d0431b714, user_id=a0aa795a8bb7465c8ec41329f64dcf30, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.489355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.506384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 971/1931] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:47 2022] PUT /identity/v3/projects/417f7260b8ce4928bdd3221d0431b714/users/a0aa795a8bb7465c8ec41329f64dcf30/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.506926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.510590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.551927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 961/1932] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:47.552717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.564479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a62d-f91f-4723-94c3-6f0cafcecefe None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.583585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a592d-daa6-4adf-b088-c1d99686ab9f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.587634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.588531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.588973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.589505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.638492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.639173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.639450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.639722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] PATH_INFO: `/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe/users/443c5358357e4ef9b2afc5f81bead5d8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.641736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9fba3c4c914edf9c9c3632c953a0fe, user_id=443c5358357e4ef9b2afc5f81bead5d8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.644545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.655676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 962/1933] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:47 2022] PUT /identity/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe/users/443c5358357e4ef9b2afc5f81bead5d8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.656529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.657566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.659190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.671054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 972/1934] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:47.671960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.681945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269c0b-8bc2-44ce-b2e3-9b37b671b452 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.684027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.731940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bb23e-c56b-4dce-b18c-58e2614a0112 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.738680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.739376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.740221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.740498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.741204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.742783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.746319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.746947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.747208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.747484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.748271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.750165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a1562-e2a5-40a4-bef6-947e6bf88306 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.755257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 963/1935] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:47.756272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.759672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.774908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d64d2-601c-482e-aa50-983623c8f8ca admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.779249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 973/1936] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:47 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:47.779474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.780180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.780458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.780723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] PATH_INFO: `/v3/projects/79d61e345d0f44889dc517770f9abed5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.780893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.781094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.781512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.783217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d61e345d0f44889dc517770f9abed5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.785307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:47.812220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] MFA Rules not processed for user `443c5358357e4ef9b2afc5f81bead5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:47.815188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.825475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.868626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d61e345d0f44889dc517770f9abed5', 'request_id': 'req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.883922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d61e345d0f44889dc517770f9abed5', 'request_id': 'req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.893561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d61e345d0f44889dc517770f9abed5', 'request_id': 'req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.910041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] The token cache is being invalidate because project 79d61e345d0f44889dc517770f9abed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:47.910477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.911113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:47.913383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 964/1937] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:47 2022] DELETE /identity/v3/projects/79d61e345d0f44889dc517770f9abed5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:47.914110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.918964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:47.919104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 974/1938] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:47.919104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:47.989342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7654195-a0b1-4496-bdc5-22a13d402c9e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:47.996078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:47.996714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:47.996991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:47.997268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:47.997961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:47.999891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace385-009c-46f6-9a49-49c6939be020 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.006913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37238bf2-40cf-4e5f-81d2-0ea9bdc1f14a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.012574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.013265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.013569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.014026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] PATH_INFO: `/v3/projects/417f7260b8ce4928bdd3221d0431b714/users/a0aa795a8bb7465c8ec41329f64dcf30/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.016282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f7260b8ce4928bdd3221d0431b714, user_id=a0aa795a8bb7465c8ec41329f64dcf30, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.020968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.023615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 975/1939] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:47 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:48.024567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.024861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.025131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.033782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 965/1940] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:47 2022] PUT /identity/v3/projects/417f7260b8ce4928bdd3221d0431b714/users/a0aa795a8bb7465c8ec41329f64dcf30/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:48.034730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.036787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.045609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:48.046751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.090509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:48.118236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e39c-651f-4e63-ac81-b48da404193b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.122802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.123522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.124043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.124531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.126096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 976/1941] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:48.126370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.127294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.130244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.147763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d6ed-3245-49ad-b7f2-c88561fc02f4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.153546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.154184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.154464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.154735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.155590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.157219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826585f-8ffb-4e4f-8462-a617fd6a8a05 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.171560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 977/1942] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:48.173367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.173848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.174398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.213874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] MFA Rules not processed for user `a0aa795a8bb7465c8ec41329f64dcf30`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:48.216685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.245677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:48.276817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.278734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7a06-ab31-464e-b093-2a7f58e04977 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.299152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 966/1943] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:48.300891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.301359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.301722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.363335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:48.366090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.388709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 967/1944] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:48.389988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.406105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 978/1945] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:48.411215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.411215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.431969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb35b50-4854-419d-a703-20c23fd1897e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.447676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6608b-4d68-492e-b3a7-4a6e0122b99c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.450092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.451819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.452277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.452691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] PATH_INFO: `/v3/projects/7670167a46714670a87aa4824984c3c0/users/de5ca1c1760944adbb737d6fef354474/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.471396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.472085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.472341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.472928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.475691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.484275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7670167a46714670a87aa4824984c3c0, user_id=de5ca1c1760944adbb737d6fef354474, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.490557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.529140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 968/1946] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:48 2022] PUT /identity/v3/projects/7670167a46714670a87aa4824984c3c0/users/de5ca1c1760944adbb737d6fef354474/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:48.533080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.535771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.630761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.632266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.636138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0d12e-1e90-492e-8bc7-49950d4e5195 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.645559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.646501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.646789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.647065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] PATH_INFO: `/v3/projects/51e0088f4f7e42249b7aba76cd788e4e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.650473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e0088f4f7e42249b7aba76cd788e4e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.651926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 979/1947] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:48.652807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.654172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.679293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7b9c-cab8-4f91-b8f9-03f8e9ea8c0a service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.688943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.690078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.690562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.691033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.693365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:48.694609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.697131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.714351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 980/1948] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:48.715486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.732111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e0088f4f7e42249b7aba76cd788e4e', 'request_id': 'req-395db4dc-30b4-4f0f-9420-67299ecfc2d8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:48.745046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e0088f4f7e42249b7aba76cd788e4e', 'request_id': 'req-395db4dc-30b4-4f0f-9420-67299ecfc2d8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:48.748395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:48.759039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e0088f4f7e42249b7aba76cd788e4e', 'request_id': 'req-395db4dc-30b4-4f0f-9420-67299ecfc2d8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:48.779276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] The token cache is being invalidate because project 51e0088f4f7e42249b7aba76cd788e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:48.779950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:48.780992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:48.784183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 969/1949] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:48 2022] DELETE /identity/v3/projects/51e0088f4f7e42249b7aba76cd788e4e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:48.786505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.789996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.801166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981487a-72a0-4f87-b481-44c3c5c149ca admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.869470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:48.875605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.876950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.879495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.880514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.883973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.919075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db4dc-30b4-4f0f-9420-67299ecfc2d8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.925329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.926413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.927059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.927411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.928814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.930453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:48.950790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 970/1950] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:48.950790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:48.952644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:48.971431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e7c3-19c6-460d-ab08-db8dbce61a33 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:48.986376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:48.987029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:48.987286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:48.987560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:48.988932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:48.991453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.000771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.002352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.018199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 981/1951] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:49.019020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.021294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.036810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174907c-d074-4196-9277-8d4a005edef2 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.039213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 971/1952] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:49.040143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.134012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.134012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.134311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.134417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] PATH_INFO: `/v3/users/d2f4a45802c64e6384f5c5770bcda7ed` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.137696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f4a45802c64e6384f5c5770bcda7ed)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.139908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.152832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d154eb-b312-4505-8376-5958bd7fdd59 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.162739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.164992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.165283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.165575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] PATH_INFO: `/v3/projects/7670167a46714670a87aa4824984c3c0/users/de5ca1c1760944adbb737d6fef354474/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.168995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7670167a46714670a87aa4824984c3c0, user_id=de5ca1c1760944adbb737d6fef354474, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.171698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.189845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 972/1953] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:49 2022] PUT /identity/v3/projects/7670167a46714670a87aa4824984c3c0/users/de5ca1c1760944adbb737d6fef354474/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:49.195983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.220548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f4a45802c64e6384f5c5770bcda7ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:49.222145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f4a45802c64e6384f5c5770bcda7ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:49.235820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f4a45802c64e6384f5c5770bcda7ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:49.243267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f4a45802c64e6384f5c5770bcda7ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:49.250304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:49.250560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f4a45802c64e6384f5c5770bcda7ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:49.257348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 982/1954] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:49 2022] DELETE /identity/v3/users/d2f4a45802c64e6384f5c5770bcda7ed => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:49.258174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.259807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.263690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c458-7aba-4e52-9065-5c9621a41ac1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.284014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:49.337754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319167e-32ff-4e32-b98c-86262cbbb997 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.342829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.343469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.343748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.344046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.345832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.346304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.346933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.347207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.347514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.348596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.350809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaa247-ce4c-4fc6-94fe-a2e867ef1740 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.374640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 973/1955] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:49 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:49.376024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.376340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.376920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.408139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] MFA Rules not processed for user `de5ca1c1760944adbb737d6fef354474`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:49.409532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.424638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.426844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.447752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 983/1956] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:49.448601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.450034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.467454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d92e-08c0-4e89-ac69-0a9d49088d2a service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.474314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.475278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.475644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.476015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.476945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.478632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.494706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 984/1957] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:49.496094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.513437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f51f5-b356-4834-a890-79de60fc4281 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.528980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.529747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.530107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.530604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.531611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.533432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.545615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 974/1958] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:49.557305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.558968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.573185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 985/1959] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:49.574351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1692d2-1d38-49c0-aa04-11cc8a24b2b8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.577262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.587422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.588217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.588355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.588590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.597951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6fdd-1614-4b70-9918-bff3b2ebddcb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.605374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.605605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.606995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.607456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.607560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3e756-e0bb-490f-af99-4b59654243df service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.608100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] PATH_INFO: `/v3/projects/a5e39b99d17045168269f31e275f6711/users/a361055392f7493399e7a1b7c4a076ea/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.631086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e39b99d17045168269f31e275f6711, user_id=a361055392f7493399e7a1b7c4a076ea, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.635114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.645316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 975/1960] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:49 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:49.660551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 986/1961] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:49 2022] PUT /identity/v3/projects/a5e39b99d17045168269f31e275f6711/users/a361055392f7493399e7a1b7c4a076ea/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:49.674197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.675907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.676349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.714759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] MFA Rules not processed for user `a361055392f7493399e7a1b7c4a076ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:49.716368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.728301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.730077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:49.860274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:49.882097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b1e3-be84-4ee5-8e84-1139aed628ce admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:49.888079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:49.888740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:49.889015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:49.889287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] PATH_INFO: `/v3/projects/f657a4260d9349649bf0357db6de29bc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:49.890528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f657a4260d9349649bf0357db6de29bc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:49.892515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:49.912922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 976/1962] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:49.924736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:49.985862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:50.018173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f657a4260d9349649bf0357db6de29bc', 'request_id': 'req-c49a824d-5334-4dfb-af56-317e48dbb860'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.025544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f657a4260d9349649bf0357db6de29bc', 'request_id': 'req-c49a824d-5334-4dfb-af56-317e48dbb860'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.033500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9102-13d1-4039-bc96-374f0b915cc2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:50.033774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f657a4260d9349649bf0357db6de29bc', 'request_id': 'req-c49a824d-5334-4dfb-af56-317e48dbb860'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.049536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] The token cache is being invalidate because project f657a4260d9349649bf0357db6de29bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:50.050239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.052178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.058250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 987/1963] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:49 2022] DELETE /identity/v3/projects/f657a4260d9349649bf0357db6de29bc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:50.059147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:50.061301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:50.141033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:50.141653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:50.142225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:50.142501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:50.145620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:50.152872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a824d-5334-4dfb-af56-317e48dbb860 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:50.157965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:50.159207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:50.159666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:50.160647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:50.164516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:50.233024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:50.234722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:50.245171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 977/1964] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:50.245849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:50.246412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:50.247138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:50.248177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:50.259668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 988/1965] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:50 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:50.318537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4739-adfb-4406-a1e2-2dc32f25bc94 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:50.324351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:50.324874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:50.325155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:50.325428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] PATH_INFO: `/v3/users/035b446006634d57b941626970a4bf27` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:50.326625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=035b446006634d57b941626970a4bf27)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:50.328823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:50.332106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:50.388866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035b446006634d57b941626970a4bf27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.396979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035b446006634d57b941626970a4bf27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.397731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035b446006634d57b941626970a4bf27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.411544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035b446006634d57b941626970a4bf27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.422783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3bd66979-516f-4556-9fed-fc4a0968c73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035b446006634d57b941626970a4bf27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:50.430768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 978/1966] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:50 2022] DELETE /identity/v3/users/035b446006634d57b941626970a4bf27 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:50.840554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:50.861621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593798f-2fc8-4ed3-974c-609bcfc108b7 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:50.950680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:50.952096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:50.952370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:50.952636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] PATH_INFO: `/v3/projects/ef552966e80d43f2b2f91c1940557030` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:50.953821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef552966e80d43f2b2f91c1940557030)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:50.955716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:50.969366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:51.013005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef552966e80d43f2b2f91c1940557030', 'request_id': 'req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:51.020321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef552966e80d43f2b2f91c1940557030', 'request_id': 'req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:51.025964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef552966e80d43f2b2f91c1940557030', 'request_id': 'req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:51.043102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] The token cache is being invalidate because project ef552966e80d43f2b2f91c1940557030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:51.044054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:51.044720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6ed97d9-74e0-42cd-8c7d-1bf2292b427c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:51.046657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 989/1967] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:50 2022] DELETE /identity/v3/projects/ef552966e80d43f2b2f91c1940557030 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:51.053025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.053196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.053442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.112536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:51.114972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:51.211824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 979/1968] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:51.225189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.225548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.225829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.251483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:51.252956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:51.263557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 990/1969] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:51.268722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.282939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326e41-a907-4aea-9051-04fea0242067 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.290002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.290776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.291235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.292015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.293121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:51.293553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.295266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.312526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 980/1970] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:51.314846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.327063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cd7d8-da95-4a16-8993-5fece44f5fb6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.333445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.333734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.334488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.334895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.335821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.337843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.393932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 991/1971] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:51.399769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.412436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354742c5-2f10-4557-9a42-3613b70fd6e0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.507323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.508042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.508319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.508586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.509386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.511434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.534072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:51.547168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.552070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 981/1972] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:51.560309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8b8ac-e39a-4cc9-8c05-ea3157b8d668 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.565873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.567637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.568021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.568297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.569008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.570614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.584144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 992/1973] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:51.588406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.599554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e4ba-30ad-4ceb-b24e-0a4c73ea52a4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.604543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.605265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.605448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.605724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.606426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.608216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87ca83-a6d3-42a6-9075-31f2e45c67b9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.624284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 982/1974] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:51.628494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.641735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9362a4-930e-4f1b-9aca-471a2d807b36 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.649030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.649721 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.650061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.650284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] PATH_INFO: `/v3/projects/098b2c1621e34f999fa0c2be7ace335a/users/14609f5468f54b44b9d0b823d92e614a/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.670765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098b2c1621e34f999fa0c2be7ace335a, user_id=14609f5468f54b44b9d0b823d92e614a, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.673967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:51.690694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 993/1975] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:51 2022] PUT /identity/v3/projects/098b2c1621e34f999fa0c2be7ace335a/users/14609f5468f54b44b9d0b823d92e614a/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:51.703500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.703771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.704068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.738930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] MFA Rules not processed for user `14609f5468f54b44b9d0b823d92e614a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:51.740451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:51.846563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 983/1976] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:51.851280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:51.967398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9189c-7855-4c74-88ce-f04eb72bfaf9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:51.980682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:51.984547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:51.984547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:51.984547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:51.985474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:51.987604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.047006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 994/1977] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:51 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:52.060750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.084949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88a155-4a36-4028-bcea-5952f00940dd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.172675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.173492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.173751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.174025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.174728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.178140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.200621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 984/1978] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:52 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:52.204683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.218123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7de-b54e-4991-a0cd-246ae1ff15a3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.224437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.225273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.225560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.225851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.228400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.230318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.246822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 995/1979] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:52.248004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.262099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a177aba-fa01-4abc-8033-4865cb090cf3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.267669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.268377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.268748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.269117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] PATH_INFO: `/v3/projects/a2cd3fca72d143feb4306e39832067e2/users/70122069007d4e72887fda71d1936a71/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.288624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cd3fca72d143feb4306e39832067e2, user_id=70122069007d4e72887fda71d1936a71, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.291703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.311382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 985/1980] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:52 2022] PUT /identity/v3/projects/a2cd3fca72d143feb4306e39832067e2/users/70122069007d4e72887fda71d1936a71/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:52.315062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.330363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d335c8-1dab-4493-ba62-24017c57095a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.348653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:52.437730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.438695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.439093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.439500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.440279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.442542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feec32-dba9-4481-9fb1-414663722d13 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.455169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 996/1981] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:52.460124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.485102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb563ac-dff7-419f-ac0b-e371b484732f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.491716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.492615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.492918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.493290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] PATH_INFO: `/v3/projects/a2cd3fca72d143feb4306e39832067e2/users/70122069007d4e72887fda71d1936a71/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.497358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cd3fca72d143feb4306e39832067e2, user_id=70122069007d4e72887fda71d1936a71, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.500447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.517430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 986/1982] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:52 2022] PUT /identity/v3/projects/a2cd3fca72d143feb4306e39832067e2/users/70122069007d4e72887fda71d1936a71/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:52.529073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.529379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.529724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.575086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] MFA Rules not processed for user `70122069007d4e72887fda71d1936a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:52.576359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:52.651722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 997/1983] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:52.664177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.665958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:52.707806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:52.734627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ebda7-27ed-4248-b095-bde3f8653eee admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:52.738917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:52.739525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:52.739823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:52.740097 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:52.748948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:52.750348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d7098-59da-4771-a95b-a9d25e7c3bb9 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:52.760117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 987/1984] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:52.984869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:52.986277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.053456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b329-88b4-4783-9a10-9ce313a6a210 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:53.059183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:53.059877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.060124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.060393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] PATH_INFO: `/v3/users/d700e537bd0b471f816558a14e2e2a6a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.061599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d700e537bd0b471f816558a14e2e2a6a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:53.063498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:53.104552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:53.119365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd700e537bd0b471f816558a14e2e2a6a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.120109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd700e537bd0b471f816558a14e2e2a6a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.132278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd700e537bd0b471f816558a14e2e2a6a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.139062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd700e537bd0b471f816558a14e2e2a6a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.148544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd700e537bd0b471f816558a14e2e2a6a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.157647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 998/1985] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:52 2022] DELETE /identity/v3/users/d700e537bd0b471f816558a14e2e2a6a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:53.159436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.159860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.161149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.218330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:53.221811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.223568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:53.225023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.289470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 988/1986] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:53.299637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:53.301583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.303849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38050-5939-46c9-bdd2-456c81691304 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:53.308450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:53.309089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.309370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.309639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] PATH_INFO: `/v3/users/14609f5468f54b44b9d0b823d92e614a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.310797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14609f5468f54b44b9d0b823d92e614a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:53.312728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:53.365111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14609f5468f54b44b9d0b823d92e614a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.366057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14609f5468f54b44b9d0b823d92e614a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.367414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a29a-106a-4d4f-937b-bbedc97e81c7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:53.371257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:53.371902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.372386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.372552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.374678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.379918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14609f5468f54b44b9d0b823d92e614a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.386918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14609f5468f54b44b9d0b823d92e614a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.387546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:53.389291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934f6a6-1a88-4443-9af7-04e7478197e6 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:53.395257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14609f5468f54b44b9d0b823d92e614a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.403825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 989/1987] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:53.404052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 999/1988] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:53 2022] DELETE /identity/v3/users/14609f5468f54b44b9d0b823d92e614a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:53.410897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.411400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.412155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.436586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:53.439836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.512134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 990/1989] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:53.527482 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:53.529211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.586360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:53.632443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713bba-602d-4ed8-913d-a8e6fd752870 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:53.637931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:53.638571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.639017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.639296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.659551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:53.661525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:53.674144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1000/1990] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:53.823838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:53.825274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:53.847110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9fd57-a3e3-4c8c-9a4e-155ec5ef7051 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:53.852793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:53.853456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:53.853733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:53.854000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] PATH_INFO: `/v3/projects/9a6627cb6c6b4bc7bac7e11e7bde387b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:53.855188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6627cb6c6b4bc7bac7e11e7bde387b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:53.857115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:53.869345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:53.914299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6627cb6c6b4bc7bac7e11e7bde387b', 'request_id': 'req-e7edb8a4-37e7-4eca-a558-703a0f6534ae'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.925064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6627cb6c6b4bc7bac7e11e7bde387b', 'request_id': 'req-e7edb8a4-37e7-4eca-a558-703a0f6534ae'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.932941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6627cb6c6b4bc7bac7e11e7bde387b', 'request_id': 'req-e7edb8a4-37e7-4eca-a558-703a0f6534ae'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.947681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] The token cache is being invalidate because project 9a6627cb6c6b4bc7bac7e11e7bde387b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:53.948087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.948724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:53.950465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 991/1991] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:53 2022] DELETE /identity/v3/projects/9a6627cb6c6b4bc7bac7e11e7bde387b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:53.954257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:53.965422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b431382-bc09-4444-b817-47e2141d2ec9 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:54.024940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:54.025585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.025861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.026128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] PATH_INFO: `/v3/users/443c5358357e4ef9b2afc5f81bead5d8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.027294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443c5358357e4ef9b2afc5f81bead5d8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:54.029227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:54.048713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:54.050125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.070317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb8a4-37e7-4eca-a558-703a0f6534ae admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:54.075922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:54.076593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.076854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.077123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] PATH_INFO: `/v3/projects/098b2c1621e34f999fa0c2be7ace335a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.078430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098b2c1621e34f999fa0c2be7ace335a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:54.080358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:54.088529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443c5358357e4ef9b2afc5f81bead5d8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.089218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443c5358357e4ef9b2afc5f81bead5d8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.102800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443c5358357e4ef9b2afc5f81bead5d8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.110448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443c5358357e4ef9b2afc5f81bead5d8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.120461 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443c5358357e4ef9b2afc5f81bead5d8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.126613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1001/1992] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:53 2022] DELETE /identity/v3/users/443c5358357e4ef9b2afc5f81bead5d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:54.132369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098b2c1621e34f999fa0c2be7ace335a', 'request_id': 'req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.141071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098b2c1621e34f999fa0c2be7ace335a', 'request_id': 'req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.148775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098b2c1621e34f999fa0c2be7ace335a', 'request_id': 'req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.160738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] The token cache is being invalidate because project 098b2c1621e34f999fa0c2be7ace335a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:54.161150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.161851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.163414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 992/1993] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:54 2022] DELETE /identity/v3/projects/098b2c1621e34f999fa0c2be7ace335a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:54.167933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:54.169985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.237063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:54.253187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c414-3644-4f7c-ac83-9da4bc064e19 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:54.259703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:54.260703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.260994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.261262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] PATH_INFO: `/v3/users/70122069007d4e72887fda71d1936a71` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.262669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=70122069007d4e72887fda71d1936a71)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:54.269144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:54.324996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70122069007d4e72887fda71d1936a71'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.325692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70122069007d4e72887fda71d1936a71'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.341223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70122069007d4e72887fda71d1936a71'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.350218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70122069007d4e72887fda71d1936a71'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.359737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70122069007d4e72887fda71d1936a71'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.371744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1002/1994] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:04:54 2022] DELETE /identity/v3/users/70122069007d4e72887fda71d1936a71 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:54.462488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:54.463427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.538071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aadeb-6afc-43dd-b278-04e5a1c3b7e0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:54.569388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:54.604502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:54.605379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.605882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.606112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] PATH_INFO: `/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.607463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9fba3c4c914edf9c9c3632c953a0fe)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:54.609567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:54.659359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9fba3c4c914edf9c9c3632c953a0fe', 'request_id': 'req-75916fdd-dc1c-41e2-b91c-a075283b5e25'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.669462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9fba3c4c914edf9c9c3632c953a0fe', 'request_id': 'req-75916fdd-dc1c-41e2-b91c-a075283b5e25'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.685509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9fba3c4c914edf9c9c3632c953a0fe', 'request_id': 'req-75916fdd-dc1c-41e2-b91c-a075283b5e25'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.695824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:54.697318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.702125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] The token cache is being invalidate because project ec9fba3c4c914edf9c9c3632c953a0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:54.702419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.703341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-75916fdd-dc1c-41e2-b91c-a075283b5e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.715894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39307f11-3779-43c7-9038-de3c200e54aa admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:54.723897 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 993/1995] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:54 2022] DELETE /identity/v3/projects/ec9fba3c4c914edf9c9c3632c953a0fe => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:54.727388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0543a-f90d-459b-86d4-4e8b0142b587 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.727569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0543a-f90d-459b-86d4-4e8b0142b587 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.727871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0543a-f90d-459b-86d4-4e8b0142b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.750965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e2b0543a-f90d-459b-86d4-4e8b0142b587 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:54.752242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2b0543a-f90d-459b-86d4-4e8b0142b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.796068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:54.796728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.797008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.797283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] PATH_INFO: `/v3/projects/a2cd3fca72d143feb4306e39832067e2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.798459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cd3fca72d143feb4306e39832067e2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:54.800394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:54.882407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cd3fca72d143feb4306e39832067e2', 'request_id': 'req-62462b8b-a37c-43df-af21-22db36a4452a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.895235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cd3fca72d143feb4306e39832067e2', 'request_id': 'req-62462b8b-a37c-43df-af21-22db36a4452a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.901233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 994/1996] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:54.901550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cd3fca72d143feb4306e39832067e2', 'request_id': 'req-62462b8b-a37c-43df-af21-22db36a4452a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.909478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.910559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.911184 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.921878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] The token cache is being invalidate because project a2cd3fca72d143feb4306e39832067e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:04:54.922290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.923040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62462b8b-a37c-43df-af21-22db36a4452a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:04:54.928269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1003/1997] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:04:54 2022] DELETE /identity/v3/projects/a2cd3fca72d143feb4306e39832067e2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:54.930196 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe8c-923e-4fc6-b964-aa4235bc9871 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:54.930554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe8c-923e-4fc6-b964-aa4235bc9871 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:54.930886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe8c-923e-4fc6-b964-aa4235bc9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:54.936551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:54.937922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:54.939209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:54.953834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-80bcbe8c-923e-4fc6-b964-aa4235bc9871 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:54.955379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-80bcbe8c-923e-4fc6-b964-aa4235bc9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:55.024082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:55.036326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 995/1998] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:55.039955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.048047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1004/1999] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:55.055549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.056092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.056365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.057136 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9537b-10aa-432d-9542-8c7a5305a5f5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.062916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.063622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.063999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.064397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.065336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:55.066911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.068822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.077998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:55.079268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:55.084521 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 996/2000] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:04:55.089220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.093568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1005/2001] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:55.094806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.100501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2626b6-c5e6-4ef5-835b-f1833cce893a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.105400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3d95-f9f3-4cea-b56a-57c9f45446bf None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.105783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.106505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.106788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.107158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.107851 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.110365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.110492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.110816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.111093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.111363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.112262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:04:55.112568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.114647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.129394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1006/2002] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:04:55.134467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.145879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e8ac-62d7-4e36-b80b-a61cf2dcb36b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.151135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 997/2003] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:55.152318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.223713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.224280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.224681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.224977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.225699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00d74-8417-4101-9f81-0a717b803360 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.225849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.227586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.230367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.230985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.231267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.231535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.232231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.234108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.262828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1007/2004] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:55.262966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 998/2005] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:55.264246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.264737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.289663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d02cbe-c71f-444e-9c51-7920a1a93ddd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.346469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4335-b30d-4f72-a5cc-4cda9a9ce0e1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.354656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.354984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.355265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.355699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.356437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.358364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.362700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.364035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.364313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.364585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.365283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.366907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.378630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 999/2006] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:55.382774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:55.383592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.394564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1008/2007] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:04:55.395116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc6f-39fc-41ad-9971-67a8ad6bf176 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.396615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.400339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.401026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.401371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.401705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.402626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.404134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.408351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95381af-0178-4fd7-bad5-dff6ba4d4f59 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.414005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.414906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.415288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.415666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.417962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.418101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1000/2008] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:55.420692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.422958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.432115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1009/2009] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:55.435995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.438069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae40cf-d5ca-4bb8-baa6-15dbd4786099 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.443823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.444553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.444827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.445096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] PATH_INFO: `/v3/projects/75d6ea697bf14ce89a30db8ff81187a0/users/f64a0b663910456188000c0a295742a1/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.449001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06e8d2-c906-4256-aa05-16198ffb7970 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.454180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.459351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.459351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.459351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.459351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.459351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.473370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d6ea697bf14ce89a30db8ff81187a0, user_id=f64a0b663910456188000c0a295742a1, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.475959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1010/2010] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:55.476394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e12666-e36d-4271-b1b9-e55116da44b0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.478111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.493784 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ef6fb-9ba1-42b0-86b3-72f9b8872bee admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.494162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1001/2011] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:55 2022] PUT /identity/v3/projects/75d6ea697bf14ce89a30db8ff81187a0/users/f64a0b663910456188000c0a295742a1/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:04:55.507166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349d527-c972-4718-bfbe-76992058a623 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.507449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349d527-c972-4718-bfbe-76992058a623 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.507717 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349d527-c972-4718-bfbe-76992058a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.539219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0349d527-c972-4718-bfbe-76992058a623 None None] MFA Rules not processed for user `f64a0b663910456188000c0a295742a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:55.540580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0349d527-c972-4718-bfbe-76992058a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:55.545394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:55.573462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.574371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.574746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.575117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] PATH_INFO: `/v3/projects/f516fa9f3ac2408a813061334fac1ff3/users/4fed1c6d78344ce1b18dfa2d86f8b545/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.593086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f516fa9f3ac2408a813061334fac1ff3, user_id=4fed1c6d78344ce1b18dfa2d86f8b545, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.596003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfa1a3-920a-4c62-8136-b88bf96ccbd4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.617581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1011/2012] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:55 2022] PUT /identity/v3/projects/f516fa9f3ac2408a813061334fac1ff3/users/4fed1c6d78344ce1b18dfa2d86f8b545/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:55.618155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1002/2013] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:04:55.623109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.623361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349d527-c972-4718-bfbe-76992058a623 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.623474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.623676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.636680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349d527-c972-4718-bfbe-76992058a623 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.649540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:55.650781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:55.710964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.711611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.711881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.712157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.712826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.714694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.720720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1012/2014] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:55.732692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.733948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:55.749584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1003/2015] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:55.753407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.807683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cdeb-9812-42b1-bc94-9288c423028d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.828347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:55.837455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961e5ce-04c2-4026-8b44-881d204d0eef admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.848746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.852358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.854307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.854680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.855399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.857381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.889466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1004/2016] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:55 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:55.896030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.897543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.899150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.899887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.900325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.919153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.921736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.937579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1013/2017] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:55.937940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768bed6-c9ab-44a1-a6e9-17f889d1020c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.944578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.945206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.945589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.946015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:55.946730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:55.948343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:55.961581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1005/2018] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:55.968225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:55.981032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291737f-d8e5-4d18-884c-48797eb8dd1a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:55.987028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:55.987769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:55.988787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:55.989225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] PATH_INFO: `/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc/users/a813455bb5fc4228a6fdc50b056bbc18/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.010033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf709a43254fd4a319eda9ef98cdbc, user_id=a813455bb5fc4228a6fdc50b056bbc18, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:56.013148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:56.037164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1014/2019] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:55 2022] PUT /identity/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc/users/a813455bb5fc4228a6fdc50b056bbc18/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:56.039166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:56.062662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082bb81-1933-4374-bb38-5fec9afbacc0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:56.082425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:56.167849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:56.168593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.168975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.169348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.170204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:56.172429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56cb3-3cc7-41ea-aff7-258c131f7142 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:56.192147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1006/2020] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:56.194044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:56.210582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1e0c3-42ab-4d82-b180-80ea703067e8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:56.218435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:56.219402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.219868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.220281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] PATH_INFO: `/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc/users/a813455bb5fc4228a6fdc50b056bbc18/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.224349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf709a43254fd4a319eda9ef98cdbc, user_id=a813455bb5fc4228a6fdc50b056bbc18, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:56.242617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:56.258266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1015/2021] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:56 2022] PUT /identity/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc/users/a813455bb5fc4228a6fdc50b056bbc18/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:56.271270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.271674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.272598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.320687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] MFA Rules not processed for user `a813455bb5fc4228a6fdc50b056bbc18`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:56.321924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:56.438736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1007/2022] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:56.460627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:56.462441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:56.537356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834eab-5fd4-4c1e-9118-2acd3bfce353 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:56.543236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:56.544335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.544767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.545173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.556388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:56.558122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae529-056c-4777-bc44-6188169c218e service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:56.571730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1016/2023] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:56.694832 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:56.704564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1eefd-0243-4eb4-96e3-dc2d9d35515f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:56.708674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:56.709448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.709790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.709998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.779256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:56.780771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:56.801274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1008/2024] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:04:56.814655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621631-1819-456c-a430-8b3332285f6f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:56.814948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621631-1819-456c-a430-8b3332285f6f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:56.815220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621631-1819-456c-a430-8b3332285f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:56.847631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-73621631-1819-456c-a430-8b3332285f6f None None] MFA Rules not processed for user `4fed1c6d78344ce1b18dfa2d86f8b545`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:56.850138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-73621631-1819-456c-a430-8b3332285f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:56.945022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1017/2025] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:56.949935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.033841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:57.098255 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0a488-5ebe-49b5-9065-da590312ade3 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.105936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.106561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.106831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.107096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.107757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.109941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.142162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1009/2026] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:04:56 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:57.143362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621631-1819-456c-a430-8b3332285f6f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.155158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621631-1819-456c-a430-8b3332285f6f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.166663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:57.233582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.234105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.234392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.234668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.235466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.237383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.271004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1018/2027] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:04:57 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:04:57.274883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.286785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa524101-3f41-45a8-8715-119c9a461239 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.292668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.293347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.293622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.293890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.294589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.296260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.309208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1010/2028] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:04:57.312382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.323050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b5e6-e997-4cc4-81ae-5d67791dae30 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.327713 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.328421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.328726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.329029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] PATH_INFO: `/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a/users/2ac3e904c87946c689f2a63fc1b6ec6b/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.345797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8628e2e67e9493fa7b8b7c4da13053a, user_id=2ac3e904c87946c689f2a63fc1b6ec6b, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.350510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.369515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1019/2029] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:57 2022] PUT /identity/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a/users/2ac3e904c87946c689f2a63fc1b6ec6b/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:57.375395 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.390836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c6cd-1640-44bb-9cd1-2a4d63e624b2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.473964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.475581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.475959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.476400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.477172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.478902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65ad6-0f70-49e9-867f-ed509ae706db admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.498780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1011/2030] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:04:57.503130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:57.514602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552911f-1505-4d64-b5a0-878d9d1eb168 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:57.520348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:57.521248 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:57.521585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:57.521917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] PATH_INFO: `/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a/users/2ac3e904c87946c689f2a63fc1b6ec6b/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:57.523984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8628e2e67e9493fa7b8b7c4da13053a, user_id=2ac3e904c87946c689f2a63fc1b6ec6b, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:57.526673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:57.544774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1020/2031] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:04:57 2022] PUT /identity/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a/users/2ac3e904c87946c689f2a63fc1b6ec6b/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:04:58.382438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672b7-6b29-4524-a917-6bce77708a10 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:58.384270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672b7-6b29-4524-a917-6bce77708a10 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:58.384270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62672b7-6b29-4524-a917-6bce77708a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:58.458440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f62672b7-6b29-4524-a917-6bce77708a10 None None] MFA Rules not processed for user `2ac3e904c87946c689f2a63fc1b6ec6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:58.459863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f62672b7-6b29-4524-a917-6bce77708a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:58.564175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1012/2032] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:58.578089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:58.581400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:58.712047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876dff-1d36-4a61-96fa-92b286cec1d4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:58.718962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:58.721271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:58.721945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:58.722369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:58.799719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:58.802220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5a9e6-7e7d-4799-93b4-bfc1ec24dcfe service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:58.817856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1021/2033] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:04:58.961292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:58.961581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:58.961921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:58.963244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1013/2034] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:04:58.994885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:58.995509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:58.995955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:59.025534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:04:59.027357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:59.047618 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:59.148132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1022/2035] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:04:59.163914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:04:59.165710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:04:59.215966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4469-a1ce-4b65-8885-b02b451770e4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:04:59.216625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:04:59.217467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:04:59.217724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:04:59.231721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:04:59.243295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:04:59.246118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:04:59.264340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1014/2036] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:00.409922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:00.420775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593b1c-16c7-4938-b06b-749eb5a762c2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:00.425328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:00.426684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.427045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.427496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.438401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:00.439872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25bd2-2bf1-4236-8688-284d4b7363cf service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:00.449857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1023/2037] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:00.493166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:00.494941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:00.509562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:00.569007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201765-8f2d-46ab-8e08-62300788c94b service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:00.574980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:00.575828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.576110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.576382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] PATH_INFO: `/v3/users/a361055392f7493399e7a1b7c4a076ea` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.577536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a361055392f7493399e7a1b7c4a076ea)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:00.579427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:00.641888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a361055392f7493399e7a1b7c4a076ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.649596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a361055392f7493399e7a1b7c4a076ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.650307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a361055392f7493399e7a1b7c4a076ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.662699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a361055392f7493399e7a1b7c4a076ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.671460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a361055392f7493399e7a1b7c4a076ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.678603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1015/2038] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:00 2022] DELETE /identity/v3/users/a361055392f7493399e7a1b7c4a076ea => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:00.683772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.684140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.684472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.706164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:00.708293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:00.745154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:00.746795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:00.775655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1024/2039] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:00.787212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:00.788792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:00.819420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126ff8-2e69-439f-90b5-5e1b5b92f2fc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:00.824171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:00.824828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.825091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.825365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] PATH_INFO: `/v3/users/f64a0b663910456188000c0a295742a1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.826540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64a0b663910456188000c0a295742a1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:00.828523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:00.850956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d3ced-91fe-452c-a398-8ebf8a247878 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:00.854289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:00.856794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.857081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.857402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.866973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:00.868569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:00.870085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d11ca-48d0-4dc7-abeb-4a0a3bff52df service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:00.880737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1025/2040] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:00.889716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64a0b663910456188000c0a295742a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.899908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64a0b663910456188000c0a295742a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.900478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64a0b663910456188000c0a295742a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.921005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64a0b663910456188000c0a295742a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.933090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64a0b663910456188000c0a295742a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:00.946865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1016/2041] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:00 2022] DELETE /identity/v3/users/f64a0b663910456188000c0a295742a1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:00.948100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:00.948374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:00.948716 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:00.971901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:00.974085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.040661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:01.073307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1026/2042] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:01.085589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.087685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.228681 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d4284-8c0d-49cc-8fef-947f6ec87aa9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.237532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:01.238780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.239073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.239344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.251565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:01.253196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:01.274873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1017/2043] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:01.464185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.477881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.494305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec317ee-acce-49b9-b30e-6342d32e56dc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.500399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:01.501240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.501691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.502176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] PATH_INFO: `/v3/projects/a5e39b99d17045168269f31e275f6711` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.503513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e39b99d17045168269f31e275f6711)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:01.506217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:01.537379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.538937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.553565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684309fd-c5fb-4b29-a9c8-af125eaeac6e service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.563151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e39b99d17045168269f31e275f6711', 'request_id': 'req-7bb84914-aab6-4498-add7-cd24af3b4e51'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.577429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e39b99d17045168269f31e275f6711', 'request_id': 'req-7bb84914-aab6-4498-add7-cd24af3b4e51'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.599203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e39b99d17045168269f31e275f6711', 'request_id': 'req-7bb84914-aab6-4498-add7-cd24af3b4e51'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.622931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] The token cache is being invalidate because project a5e39b99d17045168269f31e275f6711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:01.623519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.624177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7bb84914-aab6-4498-add7-cd24af3b4e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.625977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1027/2044] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:01 2022] DELETE /identity/v3/projects/a5e39b99d17045168269f31e275f6711 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:01.634856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeac4c-b7af-4148-a602-6b48313c5f05 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.635210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeac4c-b7af-4148-a602-6b48313c5f05 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.635972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeac4c-b7af-4148-a602-6b48313c5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.651899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:01.653315 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.653605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.653952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] PATH_INFO: `/v3/users/633872ea99e2473c940f2714ca8a95b8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.655223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633872ea99e2473c940f2714ca8a95b8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:01.657257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:01.662149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d4eeac4c-b7af-4148-a602-6b48313c5f05 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:01.663363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d4eeac4c-b7af-4148-a602-6b48313c5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.672906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1028/2045] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:01.683402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.685038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.685377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.724621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:01.726240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.739397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1029/2046] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:01.744755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.752872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633872ea99e2473c940f2714ca8a95b8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.755225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830556c7-70b3-4e01-a285-d7f636e01ab5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.760685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:01.761156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.761536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.761810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.762658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:01.763107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:01.763867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:01.765533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:01.768340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633872ea99e2473c940f2714ca8a95b8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.772011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633872ea99e2473c940f2714ca8a95b8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.786026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1030/2047] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:01.788857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.791550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.796283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633872ea99e2473c940f2714ca8a95b8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.808152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c594d1-b42c-4b75-908b-17e7fdebbbc4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.810542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633872ea99e2473c940f2714ca8a95b8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:01.813459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:01.814173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.814450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.814720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.815381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:01.818502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf038a6-477a-4101-bab3-dcec311189d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:01.824028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1018/2048] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:01 2022] DELETE /identity/v3/users/633872ea99e2473c940f2714ca8a95b8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:01.826458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:01.828896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.878279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1031/2049] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:01 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:01.878279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:01.878279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:01.878279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:01.903000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:01.904361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:01.934139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8993fb-a7cb-4e0e-a191-ef8e11cbb3b6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:01.982827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1032/2050] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:01.982827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.003261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c82b8-c4f7-4df7-a5c9-26824ad72bb4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.008446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.009077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.009356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.009633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.010298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.012253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.023023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.023841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.024153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.024430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] PATH_INFO: `/v3/projects/75d6ea697bf14ce89a30db8ff81187a0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.026865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d6ea697bf14ce89a30db8ff81187a0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.028954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.036628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:02.046104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1033/2051] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:01 2022] POST /identity/v3/users => generated 285 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:02.048220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.050687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.113061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d6ea697bf14ce89a30db8ff81187a0', 'request_id': 'req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.123809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d6ea697bf14ce89a30db8ff81187a0', 'request_id': 'req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.131348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d6ea697bf14ce89a30db8ff81187a0', 'request_id': 'req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.151195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] The token cache is being invalidate because project 75d6ea697bf14ce89a30db8ff81187a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:02.151852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.152751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.156635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1019/2052] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:01 2022] DELETE /identity/v3/projects/75d6ea697bf14ce89a30db8ff81187a0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:02.156635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.156847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723fc5c-2ccc-433d-944f-2212a66d472c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.159466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.178710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:02.258762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.258978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.259496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.259670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.261571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.279876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.281319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.283053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f7f52-ee5e-4a5a-9c4b-25d02df19a40 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.288955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.289700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.290049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.290443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.291611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.293575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.295382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1034/2053] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:02.296316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.301220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.307825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1020/2054] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:02.317754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0ff25-c2b9-418e-9bd4-4257192275cd service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.320356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.322782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.323426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.323891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.324213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] PATH_INFO: `/v3/users/a813455bb5fc4228a6fdc50b056bbc18` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.325420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a813455bb5fc4228a6fdc50b056bbc18)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.327550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.347017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083cecc-ff1d-44a0-a66f-5de2e2b99902 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.354659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.356356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.357206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.357860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.359153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.362217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.382489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1021/2055] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:02.389183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.403001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553ca7-0bd5-4666-a5ff-5df759970b19 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.409443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.409568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a813455bb5fc4228a6fdc50b056bbc18'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.410619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.411001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.411369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] PATH_INFO: `/v3/projects/bd9ef2c5c02b4aceab99350f591e9d49/users/d5426a47d6434f35bb7a998dcc1f6fe6/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.412070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a813455bb5fc4228a6fdc50b056bbc18'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.444769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a813455bb5fc4228a6fdc50b056bbc18'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.448986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9ef2c5c02b4aceab99350f591e9d49, user_id=d5426a47d6434f35bb7a998dcc1f6fe6, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.450423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac535c4-210e-4d11-97fe-080923efc1fa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.456319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a813455bb5fc4228a6fdc50b056bbc18'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.483844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1022/2056] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:02 2022] PUT /identity/v3/projects/bd9ef2c5c02b4aceab99350f591e9d49/users/d5426a47d6434f35bb7a998dcc1f6fe6/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:02.484014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a813455bb5fc4228a6fdc50b056bbc18'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:02.492844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.493660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.507965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1035/2057] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:02 2022] DELETE /identity/v3/users/a813455bb5fc4228a6fdc50b056bbc18 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:02.508216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.574463 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] MFA Rules not processed for user `d5426a47d6434f35bb7a998dcc1f6fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:02.578033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.714754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1023/2058] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:02.732050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:02.736673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:02.803627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:02.876183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d368d4-8f8f-455f-a27b-5f55152ec74c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:02.882113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:02.882981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:02.883236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:02.883507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:02.893837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:02.895517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:02.906485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1036/2059] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:03.090816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.092867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.121707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.123520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.266656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2908-1a9d-4195-8a63-447abc485321 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:03.267103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42db2-4652-4ab6-aa58-24f2bf7391c0 service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:03.274033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:03.274430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:03.275100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.275373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.275478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.275644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] PATH_INFO: `/v3/projects/a72cfaa1322b4fb38799517f82365a0a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.275769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.276029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] PATH_INFO: `/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.277304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cf709a43254fd4a319eda9ef98cdbc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:03.279631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72cfaa1322b4fb38799517f82365a0a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:03.279824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:03.284551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:03.286661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:03.354340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cf709a43254fd4a319eda9ef98cdbc', 'request_id': 'req-ae79201d-84ea-4541-9df8-282720bb38d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.369138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cf709a43254fd4a319eda9ef98cdbc', 'request_id': 'req-ae79201d-84ea-4541-9df8-282720bb38d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.377586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cf709a43254fd4a319eda9ef98cdbc', 'request_id': 'req-ae79201d-84ea-4541-9df8-282720bb38d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.403645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72cfaa1322b4fb38799517f82365a0a', 'request_id': 'req-56d5e4b8-968c-40b2-a5ab-deca99274287'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.403995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] The token cache is being invalidate because project d6cf709a43254fd4a319eda9ef98cdbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:03.403995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.404749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae79201d-84ea-4541-9df8-282720bb38d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.409678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1037/2060] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:03 2022] DELETE /identity/v3/projects/d6cf709a43254fd4a319eda9ef98cdbc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:03.420644 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f583-9685-4bf2-a232-fcb4c62a6c12 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.421002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72cfaa1322b4fb38799517f82365a0a', 'request_id': 'req-56d5e4b8-968c-40b2-a5ab-deca99274287'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.421669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f583-9685-4bf2-a232-fcb4c62a6c12 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.421952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f583-9685-4bf2-a232-fcb4c62a6c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.432828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72cfaa1322b4fb38799517f82365a0a', 'request_id': 'req-56d5e4b8-968c-40b2-a5ab-deca99274287'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.462265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] The token cache is being invalidate because project a72cfaa1322b4fb38799517f82365a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:03.462469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.463263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.469371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a0a7f583-9685-4bf2-a232-fcb4c62a6c12 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:03.471472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a0a7f583-9685-4bf2-a232-fcb4c62a6c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.473658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1024/2061] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:03 2022] DELETE /identity/v3/projects/a72cfaa1322b4fb38799517f82365a0a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:03.477698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.479148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.539313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:03.586683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1038/2062] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:03.588557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.589266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.589691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.626669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5e4b8-968c-40b2-a5ab-deca99274287 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:03.634898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:03.636387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.641884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:03.642821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.643426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.643925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] PATH_INFO: `/v3/users/de5ca1c1760944adbb737d6fef354474` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.646960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5ca1c1760944adbb737d6fef354474)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:03.653556 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:03.667711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1039/2063] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:03.678432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.688502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478036b9-07a6-4b5c-a904-a47a326dad6d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:03.696802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:03.697213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.697562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.697900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.698674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:03.699046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:03.701270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:03.720678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1040/2064] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:05:03.731952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.747034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd850-a20a-4001-a945-d3d280263569 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:03.763284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:03.764717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:03.764996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:03.765267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:03.766695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:03.768697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:03.769730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5ca1c1760944adbb737d6fef354474'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.781241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5ca1c1760944adbb737d6fef354474'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.781964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5ca1c1760944adbb737d6fef354474'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.798929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5ca1c1760944adbb737d6fef354474'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.809889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5ca1c1760944adbb737d6fef354474'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:03.822268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1041/2065] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:03 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:03.826981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:03.827863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1025/2066] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:03 2022] DELETE /identity/v3/users/de5ca1c1760944adbb737d6fef354474 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:03.833593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:03.927714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2346-306c-4cdc-a279-249c962a7994 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.025316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.025950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.026226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.026492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.027158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.038957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.074393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1042/2067] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:03 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:04.078607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.089469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f868f-1911-43ee-baa0-e663be9b8166 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.094759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.095386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.095655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.095984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.096691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.098378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.103772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:04.122167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1026/2068] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:04.132573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.154448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b59c8-62b2-49f4-8be1-5cedb1e3ebbe admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.159455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.160157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.160676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.160676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.161395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.163007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb665-dd74-4105-8596-b3d3d8cafbb5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.179027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1043/2069] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:04.180642 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.213233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bdc0-9053-4ea4-9576-e3a063e6a53e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.221734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.223307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.223958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.224550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] PATH_INFO: `/v3/projects/c941cf7334a34d92b5a01680182177b5/users/45d78691cf1040f5a72e57f4468c02ba/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.247005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c941cf7334a34d92b5a01680182177b5, user_id=45d78691cf1040f5a72e57f4468c02ba, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.249999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.275833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1027/2070] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:04 2022] PUT /identity/v3/projects/c941cf7334a34d92b5a01680182177b5/users/45d78691cf1040f5a72e57f4468c02ba/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:04.283708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.284060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.284367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.335478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] MFA Rules not processed for user `45d78691cf1040f5a72e57f4468c02ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:04.336939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:04.374162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:04.434812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.437374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:04.475420 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1044/2071] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:04.480305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.578868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28220-4ea2-4934-8541-4b41078e169d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.592795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.595611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.596050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.596684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] PATH_INFO: `/v3/projects/7670167a46714670a87aa4824984c3c0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.599757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7670167a46714670a87aa4824984c3c0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.607475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.667142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf800-61d3-421f-81b5-233dbd8c9bf9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.672193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.672881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.673219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.673551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.674307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.677199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.718274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7670167a46714670a87aa4824984c3c0', 'request_id': 'req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:04.720524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1045/2072] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:04 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:04.724775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.734348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7670167a46714670a87aa4824984c3c0', 'request_id': 'req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:04.744360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7670167a46714670a87aa4824984c3c0', 'request_id': 'req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:04.758706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] The token cache is being invalidate because project 7670167a46714670a87aa4824984c3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:04.758993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:04.759710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8205f0eb-fd3a-4ca7-a920-35ddab225ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:04.763825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1028/2073] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:04 2022] DELETE /identity/v3/projects/7670167a46714670a87aa4824984c3c0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:04.767901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138763-c8b9-4076-8ef4-3c73b98d7fc3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.768371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138763-c8b9-4076-8ef4-3c73b98d7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.768889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138763-c8b9-4076-8ef4-3c73b98d7fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.791740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-09138763-c8b9-4076-8ef4-3c73b98d7fc3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:04.793467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-09138763-c8b9-4076-8ef4-3c73b98d7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:04.829866 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca053-7414-41ba-8b91-e4c3b29668a9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.839068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.839871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.840369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.840861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.841609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.843728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.872437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1029/2074] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:04.882403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.882690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.886084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.886216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1046/2075] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:04 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:04.886802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.888874 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:04.892762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:04.908876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258756e5-e29f-4548-aeb6-5ef0844c12b2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.909343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:04.914677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:04.921320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.922652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.923075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.923603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.924532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.925421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1030/2076] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:04.928792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.931552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.951253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1047/2077] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:04.952602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:04.953351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a87402-0e6a-4126-8837-a99812d072a9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.959353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.960652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.961005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.961347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.962116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:04.962480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:04.964211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:04.971935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25d0a-5457-4481-9f23-3db7136a793a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:04.978938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:04.979838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:04.980375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:04.980850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] PATH_INFO: `/v3/projects/ca39fa37097d4386833a1e280c999697/users/2753e3c23ba4417c8572f6af48b2231f/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:04.997017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1031/2078] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:05.001515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca39fa37097d4386833a1e280c999697, user_id=2753e3c23ba4417c8572f6af48b2231f, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.001691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.004786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.015256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:05.018420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e8f5a-03be-4a56-b321-b176409b31b9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.021765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1048/2079] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:04 2022] PUT /identity/v3/projects/ca39fa37097d4386833a1e280c999697/users/2753e3c23ba4417c8572f6af48b2231f/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:05.026003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.128125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.129773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.130307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.130946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.132044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.134434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.142870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba7e0-6171-4b78-9808-816dfdbb7e4e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.165303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.170143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.171545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.172093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.173409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.176426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.198093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1032/2080] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:05 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:05.199500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.208289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1049/2081] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:05.213847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.228719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc08b70-a54c-4cbc-85b0-adaae7d706a1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.308825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5399a-7678-40a2-9a50-9f81e0cd398d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.344391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.347158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.348264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.349095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.349986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.352390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c763cb3-ffeb-4bbd-bd79-310b319dbc76 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.379616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.381351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.382227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.382682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] PATH_INFO: `/v3/projects/ca39fa37097d4386833a1e280c999697/users/2753e3c23ba4417c8572f6af48b2231f/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.387725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca39fa37097d4386833a1e280c999697, user_id=2753e3c23ba4417c8572f6af48b2231f, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.392782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.417991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1050/2082] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:05 2022] PUT /identity/v3/projects/ca39fa37097d4386833a1e280c999697/users/2753e3c23ba4417c8572f6af48b2231f/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:05.418103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1033/2083] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:05 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:05.421250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.422473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.425087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.431618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.588626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] MFA Rules not processed for user `2753e3c23ba4417c8572f6af48b2231f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:05.591315 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:05.636418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc28624-740e-474f-ab0d-cd78730e9559 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.652235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.652961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.653299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.654022 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.654808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.657652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.672803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1051/2084] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:05.675710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.704641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24000-ad48-4831-9ade-cbfcafce3e26 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.719578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.720245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.720522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.720791 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.721522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.724538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.727215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:05.744509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1052/2085] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:05.749271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.783755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668dd7d-2e9d-46cd-8d69-5fc4872a8de5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.785733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1034/2086] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:05.798011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:05.798343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.798343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.798764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] PATH_INFO: `/v3/projects/9754d64ce5764c5e8d32523a7709a4e7/users/9ac79d26f20f4dd093142045962bd517/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.834347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9754d64ce5764c5e8d32523a7709a4e7, user_id=9ac79d26f20f4dd093142045962bd517, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:05.840240 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:05.841754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:05.842522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41420e57-d137-44fb-b06e-a92567e97ddf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:05.845451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:05.885477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1053/2087] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:05 2022] PUT /identity/v3/projects/9754d64ce5764c5e8d32523a7709a4e7/users/9ac79d26f20f4dd093142045962bd517/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:05.908638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:05.909031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:05.909417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:05.951965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aa38-21a0-4abc-b702-e9498f191279 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:05.954185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] MFA Rules not processed for user `9ac79d26f20f4dd093142045962bd517`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:05.955930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:06.059872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:06.060604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:06.061032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:06.061306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:06.106242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1054/2088] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:06.171628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:06.175551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:06.203031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1035/2089] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:06.292076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:06.305939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de33a59-7a1a-4f74-9a94-265ad7fe1161 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:06.311017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:06.312163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:06.312680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:06.313197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:06.333718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:06.336301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:06.355896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1055/2090] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:06.541520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:06.542338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:06.564636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12bc2-0c4e-4aef-9ccd-ba4cfbfd0f2d service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:06.579220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:06.580204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:06.580204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:06.580427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:06.583653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:06.725393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:06.747849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:06.749370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb67f-0e57-4997-9850-eec32f40779b service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:06.771293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1036/2091] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:07.739187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:07.840067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb42d8-690d-4d6e-803b-eadf1c72c35f service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:07.845875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:07.846628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:07.846908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:07.847234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] PATH_INFO: `/v3/users/45d78691cf1040f5a72e57f4468c02ba` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:07.849243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d78691cf1040f5a72e57f4468c02ba)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:07.851298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:07.907743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d78691cf1040f5a72e57f4468c02ba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:07.908486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d78691cf1040f5a72e57f4468c02ba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:07.927571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d78691cf1040f5a72e57f4468c02ba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:07.931016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:07.939922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d78691cf1040f5a72e57f4468c02ba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:07.949710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d78691cf1040f5a72e57f4468c02ba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:07.957505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1056/2092] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:07 2022] DELETE /identity/v3/users/45d78691cf1040f5a72e57f4468c02ba => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:07.961846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:07.962441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:07.962441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:07.982087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:07.983320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:08.059203 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1037/2093] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:08.071203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:08.072746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:08.172494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ceb58-b1f1-4a3f-aef2-dbea723965ec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:08.182056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:08.182778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:08.183132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:08.183405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:08.201826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:08.204039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:08.217513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1057/2094] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:08.639256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:08.641435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:08.661942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e76e-7f1a-4cac-b5ea-7dad5135419b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:08.680563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:08.681426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:08.681858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:08.682306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] PATH_INFO: `/v3/projects/c941cf7334a34d92b5a01680182177b5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:08.684113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c941cf7334a34d92b5a01680182177b5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:08.686037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:08.803852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c941cf7334a34d92b5a01680182177b5', 'request_id': 'req-ab007ba7-b117-49f0-99f0-e75521732c1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:08.814223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c941cf7334a34d92b5a01680182177b5', 'request_id': 'req-ab007ba7-b117-49f0-99f0-e75521732c1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:08.823457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c941cf7334a34d92b5a01680182177b5', 'request_id': 'req-ab007ba7-b117-49f0-99f0-e75521732c1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:08.857376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] The token cache is being invalidate because project c941cf7334a34d92b5a01680182177b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:08.857986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:08.858937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:08.872807 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1038/2095] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:08 2022] DELETE /identity/v3/projects/c941cf7334a34d92b5a01680182177b5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:08.873580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:08.893280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356805bf-145e-42dc-9fb9-19add858148c service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:09.013384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:09.014127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:09.014408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:09.014683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] PATH_INFO: `/v3/users/2753e3c23ba4417c8572f6af48b2231f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:09.016566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2753e3c23ba4417c8572f6af48b2231f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:09.026840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:09.125603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2753e3c23ba4417c8572f6af48b2231f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.127416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2753e3c23ba4417c8572f6af48b2231f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.153072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2753e3c23ba4417c8572f6af48b2231f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.198289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2753e3c23ba4417c8572f6af48b2231f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.232214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d24eb15a-3539-4dd4-9fd5-a94e9abf54e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2753e3c23ba4417c8572f6af48b2231f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.244222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1058/2096] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:08 2022] DELETE /identity/v3/users/2753e3c23ba4417c8572f6af48b2231f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:09.633834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:09.635497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:09.664906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007ba7-b117-49f0-99f0-e75521732c1e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:09.723938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:09.724598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:09.724870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:09.725141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] PATH_INFO: `/v3/projects/ca39fa37097d4386833a1e280c999697` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:09.726329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca39fa37097d4386833a1e280c999697)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:09.728236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:09.745718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:09.783435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca39fa37097d4386833a1e280c999697', 'request_id': 'req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.793290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca39fa37097d4386833a1e280c999697', 'request_id': 'req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.801816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca39fa37097d4386833a1e280c999697', 'request_id': 'req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.814482 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] The token cache is being invalidate because project ca39fa37097d4386833a1e280c999697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:09.815012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.815671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ef3487c3-0993-41ba-a2e5-c5c3e5877e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:09.818436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1039/2097] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:09 2022] DELETE /identity/v3/projects/ca39fa37097d4386833a1e280c999697 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:09.823670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:09.824020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:09.824346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:09.839678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:09.847283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:09.850142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:09.913360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1059/2098] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:09.921655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:09.921944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:09.922221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:09.942665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:09.943909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:09.951852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1040/2099] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:09.956158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:09.966531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc8d0-6056-4bb4-ba6d-e6c3e9ed9a33 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:09.970983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:09.971599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:09.971908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:09.972180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:09.973628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:09.973982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:09.975718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:09.987762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1060/2100] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:05:09.993213 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.002680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39c82e-afd4-41e9-aa7f-d04ff107cb23 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.008238 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.008882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.009157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.009431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.010093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.012063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.042538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1041/2101] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:10.046864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.057971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b4ff-5d3d-4e8a-aefd-7296006f7c0f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.118102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.118725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.118999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.119268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.119954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.121838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.144391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1061/2102] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:10 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:10.149637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.161457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864a3f-176e-4be3-b91b-c2a4a614d848 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.166674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.167288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.167864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.168144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.168834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.170405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.183223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1042/2103] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:10.187576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.198944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e36ab-6a40-4c29-938c-1e0a2838bd9e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.204213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.204870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.205138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.205449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.206352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.208987 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ebec4-382d-4ba9-81df-d63f778d9e9f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.220229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1062/2104] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:10.225193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.238031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac8867-149f-4f2b-8c00-5819bbfc7223 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.242909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.243572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.243889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.244164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] PATH_INFO: `/v3/projects/7aa0991363fb4bae96a74028ff14a04a/users/b95d2176a6a844859b2fe43c4a6b5fe3/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.260418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa0991363fb4bae96a74028ff14a04a, user_id=b95d2176a6a844859b2fe43c4a6b5fe3, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.263177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.282837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1043/2105] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:10 2022] PUT /identity/v3/projects/7aa0991363fb4bae96a74028ff14a04a/users/b95d2176a6a844859b2fe43c4a6b5fe3/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:10.295334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.295617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.295923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.324284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] MFA Rules not processed for user `b95d2176a6a844859b2fe43c4a6b5fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:10.325485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.390566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1063/2106] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:10.403155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.404868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.463726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cddb-fc9f-4975-9300-409da7449f86 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.467923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.468541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.468813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.469071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.479036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.480697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.490888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1044/2107] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:10.511940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.516462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:10.590077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffbb3-f9b9-41bb-85fc-e2fefe0b3712 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.595133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.595929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.596075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.596342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] PATH_INFO: `/v3/users/b95d2176a6a844859b2fe43c4a6b5fe3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.597571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95d2176a6a844859b2fe43c4a6b5fe3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.599960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.621122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.622931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.647546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d269f7d-0bbc-42de-a572-30ca9b453ab0 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.654766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:10.655737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.656237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.656694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] PATH_INFO: `/v3/users/9ac79d26f20f4dd093142045962bd517` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.658647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac79d26f20f4dd093142045962bd517)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:10.661773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:10.666973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95d2176a6a844859b2fe43c4a6b5fe3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.668164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95d2176a6a844859b2fe43c4a6b5fe3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.685393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95d2176a6a844859b2fe43c4a6b5fe3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.694198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95d2176a6a844859b2fe43c4a6b5fe3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.704486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-49a75dcc-fa52-4317-9e42-3e14ac48b970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95d2176a6a844859b2fe43c4a6b5fe3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.714359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1064/2108] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:10 2022] DELETE /identity/v3/users/b95d2176a6a844859b2fe43c4a6b5fe3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:10.722096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.722519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.723538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.752095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:10.774289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:10.776452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.779082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac79d26f20f4dd093142045962bd517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.792418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac79d26f20f4dd093142045962bd517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.794274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac79d26f20f4dd093142045962bd517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.809976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac79d26f20f4dd093142045962bd517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.819529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-925a4dc4-1078-4741-a489-2f619d09327c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac79d26f20f4dd093142045962bd517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:10.830942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1045/2109] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:10 2022] DELETE /identity/v3/users/9ac79d26f20f4dd093142045962bd517 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:10.835961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:10.836360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:10.836740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:10.853425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1065/2110] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:10.865619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:10.866771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.869253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:10.871283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:10.904778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:10.940681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbbb45-ac62-4c20-90a5-52c8b3679863 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:10.962664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1046/2111] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:10.969207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:11.006214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:11.006921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.007200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.007466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.017540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:11.018980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:11.034405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a5a5-5579-48ae-a423-fb4ec1bf4149 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:11.040462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1066/2112] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:11.040771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:11.041456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.041736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.042009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.058469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:11.060310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:11.072977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1047/2113] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:11.695925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:11.697575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:11.720475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f581254-2477-4f88-b7f9-fff986069cd7 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:11.726901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:11.727703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.728312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.728691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] PATH_INFO: `/v3/projects/7aa0991363fb4bae96a74028ff14a04a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.730148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa0991363fb4bae96a74028ff14a04a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:11.747072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:11.749705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:11.751747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:11.772827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cead51-7bda-4472-af53-a27053fcfcdf service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:11.778190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:11.779039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.779389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.779727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] PATH_INFO: `/v3/projects/9754d64ce5764c5e8d32523a7709a4e7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.781622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9754d64ce5764c5e8d32523a7709a4e7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:11.783846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:11.835989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa0991363fb4bae96a74028ff14a04a', 'request_id': 'req-630cd3c2-15b3-4282-8013-fb83c76fdaba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.842630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9754d64ce5764c5e8d32523a7709a4e7', 'request_id': 'req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.842857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa0991363fb4bae96a74028ff14a04a', 'request_id': 'req-630cd3c2-15b3-4282-8013-fb83c76fdaba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.846235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:11.849550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa0991363fb4bae96a74028ff14a04a', 'request_id': 'req-630cd3c2-15b3-4282-8013-fb83c76fdaba'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.852786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9754d64ce5764c5e8d32523a7709a4e7', 'request_id': 'req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.860459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9754d64ce5764c5e8d32523a7709a4e7', 'request_id': 'req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.865197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] The token cache is being invalidate because project 7aa0991363fb4bae96a74028ff14a04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:11.865492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.866512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-630cd3c2-15b3-4282-8013-fb83c76fdaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.867889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1067/2114] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:11 2022] DELETE /identity/v3/projects/7aa0991363fb4bae96a74028ff14a04a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:11.873159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836b16-2bb6-4408-a65b-9ba41dbdba63 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.873444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836b16-2bb6-4408-a65b-9ba41dbdba63 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.873800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836b16-2bb6-4408-a65b-9ba41dbdba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.875090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] The token cache is being invalidate because project 9754d64ce5764c5e8d32523a7709a4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:11.875381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.876077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5a92e48c-a1f4-4dee-8285-77cef08a8dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:11.877658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1048/2115] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:11 2022] DELETE /identity/v3/projects/9754d64ce5764c5e8d32523a7709a4e7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:11.885014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31175-f208-4148-ad74-c9b2e0483416 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.885443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31175-f208-4148-ad74-c9b2e0483416 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.885988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31175-f208-4148-ad74-c9b2e0483416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.909283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ec836b16-2bb6-4408-a65b-9ba41dbdba63 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:11.909428 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-67d31175-f208-4148-ad74-c9b2e0483416 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:11.911114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-67d31175-f208-4148-ad74-c9b2e0483416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:11.912632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ec836b16-2bb6-4408-a65b-9ba41dbdba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:11.989969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1068/2116] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:11.990711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1049/2117] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:11.998897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.999274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.999373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:11.999545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:11.999730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:11.999896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.011063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:12.026781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:12.027903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:12.028351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.029478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.039824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1050/2118] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:12.042113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1069/2119] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:12.044617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.046555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.057208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5116-c5aa-4cda-b0e9-1bc232232ff6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.057501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312dd22-251f-46e7-a2a7-be74dd18ac2e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.062884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.063081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.063654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.063824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.063999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.064131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.064292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.064431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.065045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:12.065161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:12.065352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.065493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.068112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.068594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.081476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1051/2120] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:12.086019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1070/2121] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:12.086170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.086932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.095898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6452f-9344-4b59-9019-54b05f0960e5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.096926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd84d-2c35-4e73-adbe-48143d83197e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.101890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.102718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.102851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.103289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.103409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.103584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.103742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.104399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.104634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.104750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.106552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.106677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.139813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1071/2122] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:12.143659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.147941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1052/2123] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:12.150942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.236194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04218ad-1b4a-459d-abd4-9735004da34d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.241890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9acd85-493d-462f-badf-68eea5e0056e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.246942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.247195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.247590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.247859 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.248033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.248171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.248308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.248443 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.248846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.249312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.253090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.254021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.313342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1072/2124] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:12.315462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1053/2125] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:12.320284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.321137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.333522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789c8e8-67ba-4a87-a34d-a21563a8f806 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.335095 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4356a-2046-4964-b88f-33dcae8416ef admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.339068 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.339928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.340187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.340604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.341612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.343206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.351935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.352959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.353493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.354287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.358652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1054/2126] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:12.359434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.360074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.362682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.381619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626d3ae-268a-4bb7-a184-b9e282c912f7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.387008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1073/2127] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:12.388187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.388718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.389077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.389352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.390289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.391373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.392007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.406912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc5cf0-3c6e-4723-be0b-c60c70ec0b07 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.409757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1055/2128] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:12.413467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.422568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.422568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.422568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.422568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.423311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.423311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.427657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f99926-73a1-4d27-9825-f39bab4e96c9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.433442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.434383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.434513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.434838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] PATH_INFO: `/v3/projects/d0aa42e32f244253a39d353d4aa6545e/users/797c36587ac746829f1f2e420d6113c4/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.435669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1074/2129] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:12.440980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.442334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:12.453579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9c2a7-7ab4-47ae-8db6-3061553e7fd4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.457544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0aa42e32f244253a39d353d4aa6545e, user_id=797c36587ac746829f1f2e420d6113c4, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.458914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.459617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.459931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.460236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] PATH_INFO: `/v3/projects/f3e5e62a505140e0875118996b9fa904/users/463df0a53ab44e47a97a479d77984e20/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.460358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778a8a2-7b4d-4ba3-bd89-abbace392aae admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.479163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e5e62a505140e0875118996b9fa904, user_id=463df0a53ab44e47a97a479d77984e20, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.481824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9eeb04-a005-4ae2-b812-4b6c8f615ac1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.482829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1056/2130] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:12 2022] PUT /identity/v3/projects/d0aa42e32f244253a39d353d4aa6545e/users/797c36587ac746829f1f2e420d6113c4/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:12.497088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.497370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.497638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.500293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1075/2131] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:12 2022] PUT /identity/v3/projects/f3e5e62a505140e0875118996b9fa904/users/463df0a53ab44e47a97a479d77984e20/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:12.512300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.512586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.512863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.532332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] MFA Rules not processed for user `797c36587ac746829f1f2e420d6113c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:12.533794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.545657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] MFA Rules not processed for user `463df0a53ab44e47a97a479d77984e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:12.546938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.613004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:12.615007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1057/2132] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:12.622654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.632827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1076/2133] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:12.648326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.650473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.709925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83b6b3-e8c2-44d8-b8c9-ba92eaa3552a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.713652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f337ba-cd5d-4cd1-b60e-a5d8ffa87d7b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.715177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.716389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.716665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.716936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.717616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.719496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.721513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.722273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.722496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.723522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.732995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.734412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.745033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1077/2134] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:12.745970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.747766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:12.758736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1058/2135] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:12.760127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.767849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869a788-e6d6-4828-ad35-79d1c3177f4a service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.828266 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:12.834995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c96ada-b563-45d7-bdd9-251e0caae814 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.850844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.851639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.853490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.853770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.854449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.856529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.871112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.871875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.872093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.872368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] PATH_INFO: `/v3/users/c63e749a3c6442a184ebffafadbc9ccf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.879838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63e749a3c6442a184ebffafadbc9ccf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.882818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.893833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1059/2136] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:12 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:12.899285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.919875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bbf9c-6500-46b2-9096-4a4c2bc60806 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.926803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.927538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.927966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.928562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.929175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.930863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.944561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1060/2137] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:12.948921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.951343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63e749a3c6442a184ebffafadbc9ccf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:12.952015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63e749a3c6442a184ebffafadbc9ccf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:12.960760 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be2846-07e8-4841-b330-61d813ba0481 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:12.965795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:12.966483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:12.966830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:12.967190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:12.967930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:12.968412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63e749a3c6442a184ebffafadbc9ccf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:12.969667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:12.976684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63e749a3c6442a184ebffafadbc9ccf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:12.982711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1061/2138] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:12.986794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7903a2e8-136e-4b49-82bd-ea8a57e3c5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63e749a3c6442a184ebffafadbc9ccf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:12.987587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:12.992020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.000176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1078/2139] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:12 2022] DELETE /identity/v3/users/c63e749a3c6442a184ebffafadbc9ccf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:13.013321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698874d2-005b-4f20-bf73-2237a3132e53 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.013417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.013777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.014059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.042105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:13.043977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.071422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:13.107107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.107800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.108083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.108941 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] PATH_INFO: `/v3/projects/d05cc5fa56864ee3b4d79a1e70fa08c6/users/b6c626b40ac445c2846a2d16b50db992/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.124272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05cc5fa56864ee3b4d79a1e70fa08c6, user_id=b6c626b40ac445c2846a2d16b50db992, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.126972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1964d51-72fd-4b33-b0f9-65dfe554759d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.128626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1079/2140] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:13.146639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1062/2141] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:12 2022] PUT /identity/v3/projects/d05cc5fa56864ee3b4d79a1e70fa08c6/users/b6c626b40ac445c2846a2d16b50db992/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:13.148425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.150101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.161673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.162164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.162741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.204411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] MFA Rules not processed for user `b6c626b40ac445c2846a2d16b50db992`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:13.205674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.227796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b9d2b-c1f4-4ff1-ae95-23b4043b3f60 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.290026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1063/2142] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:13.292581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.293568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.293846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.294900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.295508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.367882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:13.406447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3ea3-26d9-40f2-8907-61d55990cd0d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.418380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.423698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.424013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.424293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.424993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.431128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.467241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.468875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.474305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1064/2143] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:13 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:13.478273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.482773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1080/2144] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:13.561503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc47a-21d2-4a01-b28a-995d65fff32b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.570371 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.571007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.571283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.571552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.572258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.574234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.601465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1065/2145] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:13 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:13.605958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.618400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8f310-c2fc-4e63-a0c1-a736a1a4452c service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.623223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.624208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.624208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.624439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.625150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.626675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.642623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1081/2146] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:13.646892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.657880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f53a-ec38-4044-888a-599613b19832 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.664017 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.664699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.664978 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.665326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] PATH_INFO: `/v3/projects/435a2ab170594272b0a1279ba55d5551/users/cd9180708050405593ce29183072cfe8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.690033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=435a2ab170594272b0a1279ba55d5551, user_id=cd9180708050405593ce29183072cfe8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.692804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.719841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1066/2147] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:13 2022] PUT /identity/v3/projects/435a2ab170594272b0a1279ba55d5551/users/cd9180708050405593ce29183072cfe8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:13.724827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.744784 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09172a-9076-4080-8824-467578cf0182 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.757424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:13.822523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.827179 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.829259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.829808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.830429 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.835581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.846943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1082/2148] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:13.852718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.857113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:13.869353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5f12-0b74-4a8d-b8ef-f45361d1e3df admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.872211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.884514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.885533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.885812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.886080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] PATH_INFO: `/v3/projects/435a2ab170594272b0a1279ba55d5551/users/cd9180708050405593ce29183072cfe8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.893429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435a2ab170594272b0a1279ba55d5551, user_id=cd9180708050405593ce29183072cfe8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.896646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66101-a797-4455-a3e3-9d69e355b127 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:13.906007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:13.906301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e90a-761f-47d6-9e53-d4f302d2d195 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.907041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.907467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.908282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] PATH_INFO: `/v3/projects/acdc655640bb401ea7af08659250d536` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.910643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdc655640bb401ea7af08659250d536)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:13.912622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:13.921359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1067/2149] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:13 2022] PUT /identity/v3/projects/435a2ab170594272b0a1279ba55d5551/users/cd9180708050405593ce29183072cfe8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:13.933573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:13.933879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:13.934133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:13.971988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] MFA Rules not processed for user `cd9180708050405593ce29183072cfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:13.978420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:13.994744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdc655640bb401ea7af08659250d536', 'request_id': 'req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.003831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdc655640bb401ea7af08659250d536', 'request_id': 'req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.017235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdc655640bb401ea7af08659250d536', 'request_id': 'req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.046067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] The token cache is being invalidate because project acdc655640bb401ea7af08659250d536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:14.046451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.047157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.049097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1083/2150] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:13 2022] DELETE /identity/v3/projects/acdc655640bb401ea7af08659250d536 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:14.053970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:14.056568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.089934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:14.098830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1068/2151] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:14.113341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:14.116116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.150189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a529b8-8bf9-40ed-8761-a4e4a96b2e00 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:14.155932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:14.156220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.156314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.156571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] PATH_INFO: `/v3/users/a0aa795a8bb7465c8ec41329f64dcf30` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.157797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0aa795a8bb7465c8ec41329f64dcf30)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:14.159711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:14.193346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4354538-c021-4d70-b1c8-64cb7de78886 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:14.197441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:14.198093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.198404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.198629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.200409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.203960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:14.217024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0aa795a8bb7465c8ec41329f64dcf30'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.217722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0aa795a8bb7465c8ec41329f64dcf30'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.231008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0aa795a8bb7465c8ec41329f64dcf30'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.238765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0aa795a8bb7465c8ec41329f64dcf30'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.246363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0aa795a8bb7465c8ec41329f64dcf30'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.252501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1084/2152] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:14 2022] DELETE /identity/v3/users/a0aa795a8bb7465c8ec41329f64dcf30 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:14.263579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:14.265557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7b46-08f7-49c4-8f5c-7c9752a9d8c8 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:14.275483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1069/2153] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:14.602029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:14.604693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.706356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6499e-4265-4d8d-8428-f341b2d48fdc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:14.712045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:14.712686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.712963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.713233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] PATH_INFO: `/v3/projects/417f7260b8ce4928bdd3221d0431b714` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.714432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=417f7260b8ce4928bdd3221d0431b714)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:14.716372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:14.762284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417f7260b8ce4928bdd3221d0431b714', 'request_id': 'req-830cb0a0-7069-476a-9fe9-22cab7e1f29e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.768258 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417f7260b8ce4928bdd3221d0431b714', 'request_id': 'req-830cb0a0-7069-476a-9fe9-22cab7e1f29e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.774391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417f7260b8ce4928bdd3221d0431b714', 'request_id': 'req-830cb0a0-7069-476a-9fe9-22cab7e1f29e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.786981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] The token cache is being invalidate because project 417f7260b8ce4928bdd3221d0431b714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:14.787267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.787920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-830cb0a0-7069-476a-9fe9-22cab7e1f29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:14.789421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1085/2154] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:14 2022] DELETE /identity/v3/projects/417f7260b8ce4928bdd3221d0431b714 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:14.794630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.794919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.795223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.814565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:14.815762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.874134 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1070/2155] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:14.883261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.883541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.883844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.904608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:14.905838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:14.915200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1086/2156] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:14.919768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:14.929825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb169-8ff9-48a3-a67d-907c7de43d21 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:14.934500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:14.935110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.935392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.935661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.936383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:14.936684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:14.938265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:14.953420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1071/2157] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:14.954740 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:14.964622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3aa9-61da-47fa-b325-4a533e7356dd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:14.969239 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:14.969840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:14.970113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:14.970379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:14.971036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:14.973809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.009979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1087/2158] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:14 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:15.012069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.023982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e7ae-2ee5-4098-bc67-6db32f172ead admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.067649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:15.092451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.093160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.093501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.093785 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.094448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.096493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.117555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1072/2159] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:15 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:15.121789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.133471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701206f7-8dcb-4bac-bc31-f1f18c020986 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.138110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.138719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.139020 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.139291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.140017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.141593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.152954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1088/2160] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:15.156552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.167651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565384b-4b37-47bb-a3be-997771a267ec admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.173139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.173749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.174026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.174303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.174991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.177303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7848-648d-49d9-9650-670dd885306a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.189442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1073/2161] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:15.193781 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.198998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:15.205888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655537-d30b-4379-bfb3-4dc8be15e768 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.212246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.213081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.213410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.213745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] PATH_INFO: `/v3/projects/ce1c678fdfd64a988f2d8da7d82354ef/users/5b6d9a2b417a43419a533aad6c1fac48/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.230448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c678fdfd64a988f2d8da7d82354ef, user_id=5b6d9a2b417a43419a533aad6c1fac48, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.233224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.248233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1089/2162] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:15 2022] PUT /identity/v3/projects/ce1c678fdfd64a988f2d8da7d82354ef/users/5b6d9a2b417a43419a533aad6c1fac48/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:15.261542 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16baf94-d065-411d-9676-3c2d792732db None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.261824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16baf94-d065-411d-9676-3c2d792732db None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.262096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16baf94-d065-411d-9676-3c2d792732db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.291292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a16baf94-d065-411d-9676-3c2d792732db None None] MFA Rules not processed for user `5b6d9a2b417a43419a533aad6c1fac48`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:15.292594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a16baf94-d065-411d-9676-3c2d792732db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:15.371963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1074/2163] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:15.376486 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.455143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65c35-5187-4297-b285-9b560555621b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.462435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.463028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.463371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.463707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.464709 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.466604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.509728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1090/2164] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:15 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:15.511896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16baf94-d065-411d-9676-3c2d792732db None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.531663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16baf94-d065-411d-9676-3c2d792732db None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.616059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.616936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.617272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.617624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.618348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.620361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.642498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1075/2165] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:15 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:15.646897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.658746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a510d-44e5-451e-84da-6b994bd94d93 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.665316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.667419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.667981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.668278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.668991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.670581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.684155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1091/2166] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:15.688415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.699353 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6890-4353-4142-a882-9b09607d410d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.704333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.705011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.705970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.705970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] PATH_INFO: `/v3/projects/b4d2ae3e5d494873b8325eece2833465/users/421affc8ce4c47d8817b978eaf2bfde8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.724546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d2ae3e5d494873b8325eece2833465, user_id=421affc8ce4c47d8817b978eaf2bfde8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.727372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.746457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1076/2167] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:15 2022] PUT /identity/v3/projects/b4d2ae3e5d494873b8325eece2833465/users/421affc8ce4c47d8817b978eaf2bfde8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:15.747572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.765881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36012c8-5992-4780-b5f5-205ebe731608 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.844591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.845813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.846072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.846372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.847169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.849346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.871071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1092/2168] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:15.871744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.883804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e58f9-e7d4-4736-b55c-521733d05943 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:15.888519 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:15.889244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.889557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.889829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] PATH_INFO: `/v3/projects/b4d2ae3e5d494873b8325eece2833465/users/421affc8ce4c47d8817b978eaf2bfde8/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.891771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d2ae3e5d494873b8325eece2833465, user_id=421affc8ce4c47d8817b978eaf2bfde8, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:15.894402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fca091-6c5b-4703-a80a-32b234896425 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:15.898011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:15.900114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:15.921744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1077/2169] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:15 2022] PUT /identity/v3/projects/b4d2ae3e5d494873b8325eece2833465/users/421affc8ce4c47d8817b978eaf2bfde8/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:15.934817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:15.935101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:15.936109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:15.948848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:15.976988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] MFA Rules not processed for user `421affc8ce4c47d8817b978eaf2bfde8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:15.978498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:15.978737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:15.984515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48f86-5825-4909-a455-f8a82ea1b3d6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:16.059636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:16.060397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.060687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.060865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.062742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.081342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1078/2170] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:16.127188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:16.128751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.142762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e350a-ab2e-42f6-b6ee-7d48457b7b06 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:16.147452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:16.148178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.148415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.148770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.149489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:16.151451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:16.159475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:16.161098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235161e-f4c5-4ae3-a8d3-c69957d75fa9 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:16.161815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1093/2171] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:16.172742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1079/2172] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:16.349460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:16.439007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db156857-3b76-4497-8edd-9b8fb94e703f service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:16.454085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:16.454758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.455035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.455455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] PATH_INFO: `/v3/users/5b6d9a2b417a43419a533aad6c1fac48` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.456727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6d9a2b417a43419a533aad6c1fac48)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:16.459896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:16.530206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6d9a2b417a43419a533aad6c1fac48'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.531489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6d9a2b417a43419a533aad6c1fac48'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.549415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:16.551571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6d9a2b417a43419a533aad6c1fac48'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.561501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6d9a2b417a43419a533aad6c1fac48'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.568958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6d9a2b417a43419a533aad6c1fac48'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.574791 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1094/2173] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:16 2022] DELETE /identity/v3/users/5b6d9a2b417a43419a533aad6c1fac48 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:16.579643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.580023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.580779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.604607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:16.607172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.619645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:16.621285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.705895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1080/2174] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:16.717975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:16.719559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.719703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde5ec-beba-4b8e-a072-81d6a45c33b4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:16.725210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:16.726006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.726329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.726604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] PATH_INFO: `/v3/users/4fed1c6d78344ce1b18dfa2d86f8b545` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.728605 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fed1c6d78344ce1b18dfa2d86f8b545)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:16.730553 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:16.789547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1936-4516-4ab0-a9e7-dd884adc30fb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:16.793667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:16.794112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fed1c6d78344ce1b18dfa2d86f8b545'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.794432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:16.794778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:16.794880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fed1c6d78344ce1b18dfa2d86f8b545'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.795185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:16.798125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.809805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fed1c6d78344ce1b18dfa2d86f8b545'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.811216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:16.813129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:16.818178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fed1c6d78344ce1b18dfa2d86f8b545'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.826736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fed1c6d78344ce1b18dfa2d86f8b545'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:16.839080 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1081/2175] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:16.839292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1095/2176] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:16 2022] DELETE /identity/v3/users/4fed1c6d78344ce1b18dfa2d86f8b545 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:16.938514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:16.940141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:16.962988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.015369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a310e-693f-49dd-8e80-083fc25c98a2 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:17.078077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:17.080677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.103732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:17.104737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:17.105019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:17.105289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:17.107178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.182226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.188701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1be41a-cbc4-4e36-8300-21d87887bd1d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:17.202698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:17.203368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:17.208697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:17.208979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] PATH_INFO: `/v3/projects/f516fa9f3ac2408a813061334fac1ff3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:17.224493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f516fa9f3ac2408a813061334fac1ff3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:17.224493 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:17.232654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:17.234269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:17.245901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1082/2177] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:17.246834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:17.248801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.264357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95ecb5-ee41-491b-86b7-2468fe874f16 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:17.271483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:17.272455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:17.272772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:17.273161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] PATH_INFO: `/v3/projects/ce1c678fdfd64a988f2d8da7d82354ef` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:17.274812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1c678fdfd64a988f2d8da7d82354ef)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:17.276926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:17.296390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f516fa9f3ac2408a813061334fac1ff3', 'request_id': 'req-b6738517-1465-4fe3-a6a8-77ce82098ad0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.305161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f516fa9f3ac2408a813061334fac1ff3', 'request_id': 'req-b6738517-1465-4fe3-a6a8-77ce82098ad0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.317900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f516fa9f3ac2408a813061334fac1ff3', 'request_id': 'req-b6738517-1465-4fe3-a6a8-77ce82098ad0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.335668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] The token cache is being invalidate because project f516fa9f3ac2408a813061334fac1ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:17.336058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.336678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.338607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1096/2178] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:17 2022] DELETE /identity/v3/projects/f516fa9f3ac2408a813061334fac1ff3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:17.342909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:17.344268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.344837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1c678fdfd64a988f2d8da7d82354ef', 'request_id': 'req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.354170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1c678fdfd64a988f2d8da7d82354ef', 'request_id': 'req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.373883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1c678fdfd64a988f2d8da7d82354ef', 'request_id': 'req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.388091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] The token cache is being invalidate because project ce1c678fdfd64a988f2d8da7d82354ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:17.388377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.389041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.390677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1083/2179] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:17 2022] DELETE /identity/v3/projects/ce1c678fdfd64a988f2d8da7d82354ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:17.394411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:17.396808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.407221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.420276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738517-1465-4fe3-a6a8-77ce82098ad0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:17.472170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ac075-259b-4de6-8dae-2d1e4f0e1a3e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:17.477112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:17.477747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:17.478026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:17.478288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] PATH_INFO: `/v3/users/421affc8ce4c47d8817b978eaf2bfde8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:17.479443 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421affc8ce4c47d8817b978eaf2bfde8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:17.481441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:17.481904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:17.482550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:17.482831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:17.483100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] PATH_INFO: `/v3/users/2ac3e904c87946c689f2a63fc1b6ec6b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:17.484633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac3e904c87946c689f2a63fc1b6ec6b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:17.486826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:17.529777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.532524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421affc8ce4c47d8817b978eaf2bfde8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.542103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421affc8ce4c47d8817b978eaf2bfde8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.543144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421affc8ce4c47d8817b978eaf2bfde8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.547527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac3e904c87946c689f2a63fc1b6ec6b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.548354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac3e904c87946c689f2a63fc1b6ec6b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.557734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421affc8ce4c47d8817b978eaf2bfde8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.562165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac3e904c87946c689f2a63fc1b6ec6b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.565925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421affc8ce4c47d8817b978eaf2bfde8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.570714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac3e904c87946c689f2a63fc1b6ec6b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.572433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1084/2180] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:17 2022] DELETE /identity/v3/users/421affc8ce4c47d8817b978eaf2bfde8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:17.579624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac3e904c87946c689f2a63fc1b6ec6b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:17.586369 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1097/2181] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:17 2022] DELETE /identity/v3/users/2ac3e904c87946c689f2a63fc1b6ec6b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:17.902435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:17.903956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:17.984769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786704b-a0a7-4819-a916-a1799cb5dc34 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.011392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.012865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.024485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:18.059043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.060117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.060400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.060673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] PATH_INFO: `/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.062180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8628e2e67e9493fa7b8b7c4da13053a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.064306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.102160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ee21-664b-4427-9805-3a434d5e6292 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.122402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.123080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.123455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.123842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] PATH_INFO: `/v3/projects/b4d2ae3e5d494873b8325eece2833465` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.125358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d2ae3e5d494873b8325eece2833465)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.128203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.131914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8628e2e67e9493fa7b8b7c4da13053a', 'request_id': 'req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.144233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8628e2e67e9493fa7b8b7c4da13053a', 'request_id': 'req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.151926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8628e2e67e9493fa7b8b7c4da13053a', 'request_id': 'req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.168263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] The token cache is being invalidate because project f8628e2e67e9493fa7b8b7c4da13053a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:18.168661 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.169320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3ffe0834-c138-484c-aa2a-1a1f5f9f29ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.174668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1085/2182] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:17 2022] DELETE /identity/v3/projects/f8628e2e67e9493fa7b8b7c4da13053a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:18.177183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb92-5ca8-46a8-a152-27d47f63fae5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.177601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb92-5ca8-46a8-a152-27d47f63fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.177761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb92-5ca8-46a8-a152-27d47f63fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.188086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d2ae3e5d494873b8325eece2833465', 'request_id': 'req-64ce1433-7ba8-44cc-99d4-b96505e90cbf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.197934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d2ae3e5d494873b8325eece2833465', 'request_id': 'req-64ce1433-7ba8-44cc-99d4-b96505e90cbf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.202120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9495cb92-5ca8-46a8-a152-27d47f63fae5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.203513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9495cb92-5ca8-46a8-a152-27d47f63fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.204620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d2ae3e5d494873b8325eece2833465', 'request_id': 'req-64ce1433-7ba8-44cc-99d4-b96505e90cbf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.219256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] The token cache is being invalidate because project b4d2ae3e5d494873b8325eece2833465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:18.219684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.220517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64ce1433-7ba8-44cc-99d4-b96505e90cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:18.222134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1098/2183] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:18 2022] DELETE /identity/v3/projects/b4d2ae3e5d494873b8325eece2833465 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:18.227110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097dccc-b83b-4ec5-85f8-8faaab941f6f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.227400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097dccc-b83b-4ec5-85f8-8faaab941f6f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.227676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097dccc-b83b-4ec5-85f8-8faaab941f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.249278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d097dccc-b83b-4ec5-85f8-8faaab941f6f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.250519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d097dccc-b83b-4ec5-85f8-8faaab941f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.297658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1086/2184] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:18.299579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.299699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.300110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.307307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:18.330561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.331817 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.341928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1087/2185] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:18.343439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1099/2186] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:18.349608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.352515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.352763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.353036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.359456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08bf8-fa3b-4c62-b127-ef292260d420 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.364278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.364965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.365429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.366141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.366686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:18.367055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.368743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.374066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.375268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.383662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1088/2187] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:18.388249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1100/2188] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:18.388405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.392703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.402953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72750927-5720-4ad3-9944-cb4c41ee6927 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.409194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24c58-6eab-4729-8411-31a4f923091d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.410964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.411885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.412266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.412551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.413338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:18.413777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.413877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.414365 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.414654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.414946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.415605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.415852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.418319 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.440737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1101/2189] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:05:18.445504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.456736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc5c9-13ae-4fd4-8644-e99032db39f4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.461744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1089/2190] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:18.464064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.465092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.465389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.465658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.466006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.466324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.468281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.494199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:18.502824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1102/2191] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:18.508173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.548997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a089-eaa3-4c95-9482-c151312a222a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.613160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500447-73b3-422f-85fd-44ed3dcf8e75 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.618298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.619342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.619705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.620054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.620869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.623062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.625543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.626160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.626435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.626700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.627442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.630077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.651998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1103/2192] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:18.653347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.658699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1090/2193] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:18.663444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.669609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486c8e-24e4-41fe-93f5-342710c7e66f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.675337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619129-af5a-4527-a14e-56b984092a53 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.675916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.676546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.676849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.677082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.677782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.679821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.681021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.681635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.681909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.682176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.682862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.684450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.692581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1104/2194] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:18.695444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1091/2195] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:18.699647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.703332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.720440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eed95-f0cc-4bbf-b1a9-0baf49f856c1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.727316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.727978 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.728252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.728519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.729405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.730990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.746842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541c22-8a70-4e94-ab8e-b76c35eaa6b0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.753865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1105/2196] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:18.754909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.755752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.756073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.756345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.757314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.758685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.759909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.772393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1092/2197] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:18.776560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.789068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c30f62-8d36-4b40-b67f-06c9105d078b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.791709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a0e93-50fb-488e-a0c8-109a3370ed0c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:18.807848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.807848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.807848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.807848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] PATH_INFO: `/v3/projects/e0196019d5a44f42a08e6ef4a0584b50/users/b06fd95aee8345148058ba3139d5c8b4/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.808204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:18.808204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.808204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.808204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] PATH_INFO: `/v3/projects/936c7c12463f4076beb658242fd0f31d/users/2d66083a743d4699ac09e3435c8856f8/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.824434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] RBAC: Authorizing `identity:create_grant(project_id=936c7c12463f4076beb658242fd0f31d, user_id=2d66083a743d4699ac09e3435c8856f8, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.824746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0196019d5a44f42a08e6ef4a0584b50, user_id=b06fd95aee8345148058ba3139d5c8b4, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:18.827229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7c62-2425-4234-9529-e40965d1735e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.829103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76a718-7d7e-4660-adf9-592ff457af37 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:18.851029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1093/2198] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:18 2022] PUT /identity/v3/projects/936c7c12463f4076beb658242fd0f31d/users/2d66083a743d4699ac09e3435c8856f8/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:18.855771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1106/2199] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:18 2022] PUT /identity/v3/projects/e0196019d5a44f42a08e6ef4a0584b50/users/b06fd95aee8345148058ba3139d5c8b4/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:18.866171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.866698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.867157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.867377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:18.867657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:18.867966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:18.898243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] MFA Rules not processed for user `b06fd95aee8345148058ba3139d5c8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.899460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.903997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] MFA Rules not processed for user `2d66083a743d4699ac09e3435c8856f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:18.905162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.937318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:18.969760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1107/2200] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:18.981723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.983100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:18.983861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1094/2201] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:18.989735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:18.994604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.045406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8c15-af87-4b22-9b20-db4b3ed74f46 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.050579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.051581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.052176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.052653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.069355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.071890 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e7cb-ba6a-41c7-807e-a946ca9b91d8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.072013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.078869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.079845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.080256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.080605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.081699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.085787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.089656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1108/2202] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:19.127543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1095/2203] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:18 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:19.132057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.143558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d226f-fd53-4041-8b5e-3c61a25fc262 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.212886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.214129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.214129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.214129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.214426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.216643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.254558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1109/2204] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:19 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:19.258544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.271854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29349-dc6e-49eb-a3b3-f6e0b6f10541 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.279988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.280765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.281104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.281444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.282151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.283735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.295613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1096/2205] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:19.300336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.311758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2edc-55be-48bd-a478-789490fa7572 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.317525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.318212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.318619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.318904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] PATH_INFO: `/v3/projects/d4909b10b2024840ab95f65ae719d3a2/users/9f13cedb3f3f4c3ebffc945d5aff8c9c/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.343577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4909b10b2024840ab95f65ae719d3a2, user_id=9f13cedb3f3f4c3ebffc945d5aff8c9c, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.346889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.372747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1110/2206] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:19 2022] PUT /identity/v3/projects/d4909b10b2024840ab95f65ae719d3a2/users/9f13cedb3f3f4c3ebffc945d5aff8c9c/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:19.377692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.392006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934fa96-85d3-486a-b74f-407d97c9d9f7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.496014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.496738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.497089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.497433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.498199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.499882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a71a2a-9ef9-4425-8f02-06b5d72c88e1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.511122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1097/2207] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:19.515354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.526812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800880c2-3b89-4b46-8de4-3c1f786efe99 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.531533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.532399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.533122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.533563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] PATH_INFO: `/v3/projects/d4909b10b2024840ab95f65ae719d3a2/users/9f13cedb3f3f4c3ebffc945d5aff8c9c/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.536341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4909b10b2024840ab95f65ae719d3a2, user_id=9f13cedb3f3f4c3ebffc945d5aff8c9c, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.539322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.551044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1111/2208] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:19 2022] PUT /identity/v3/projects/d4909b10b2024840ab95f65ae719d3a2/users/9f13cedb3f3f4c3ebffc945d5aff8c9c/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:19.563833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.564107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.564385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.594842 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] MFA Rules not processed for user `9f13cedb3f3f4c3ebffc945d5aff8c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:19.596242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:19.673618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.679693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1098/2209] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:19.701271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.736548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.761549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360c42-d04e-4ffa-b40d-8f1a78c0dd43 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.765234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.765848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.766123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.766394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.776326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.777771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.788204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1112/2210] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:19.880245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:19.891786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130aec-afca-45b0-b17c-ad0c6f288fca None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:19.896501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:19.897132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:19.897412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:19.897688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:19.959604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:19.961067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c8821-3e0e-4252-b154-ac92ac5e9043 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:19.970299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1099/2211] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:21.301153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:21.302602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.373701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b5bc-7aa0-4efd-b895-a91c7534ade3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:21.378271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:21.378912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:21.379217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:21.379570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] PATH_INFO: `/v3/users/797c36587ac746829f1f2e420d6113c4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:21.381435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797c36587ac746829f1f2e420d6113c4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:21.383746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:21.445173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797c36587ac746829f1f2e420d6113c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.445582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797c36587ac746829f1f2e420d6113c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.459877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797c36587ac746829f1f2e420d6113c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.468514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797c36587ac746829f1f2e420d6113c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.477772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797c36587ac746829f1f2e420d6113c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.484363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1113/2212] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:21 2022] DELETE /identity/v3/users/797c36587ac746829f1f2e420d6113c4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:21.489035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:21.489565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:21.489767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:21.509659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:21.510868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.573886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1100/2213] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:21.584651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:21.591653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.656122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdaa4-6cd5-429c-a651-742655bce1e9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:21.659750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:21.660406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:21.661320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:21.661578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:21.669541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:21.672738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:21.674652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a013e-6f4d-4938-8a18-12d82e38f2ea service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:21.688061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1114/2214] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:21.709022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:21.710692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.722881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428862c-14cd-49c5-a66b-ffaa7369686b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:21.731869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:21.732532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:21.732811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:21.733084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] PATH_INFO: `/v3/users/b06fd95aee8345148058ba3139d5c8b4` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:21.734425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06fd95aee8345148058ba3139d5c8b4)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:21.736401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:21.791214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06fd95aee8345148058ba3139d5c8b4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.802326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06fd95aee8345148058ba3139d5c8b4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.803465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06fd95aee8345148058ba3139d5c8b4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.816565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06fd95aee8345148058ba3139d5c8b4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.826837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06fd95aee8345148058ba3139d5c8b4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:21.834376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1101/2215] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:21 2022] DELETE /identity/v3/users/b06fd95aee8345148058ba3139d5c8b4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:21.839004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:21.839505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:21.839828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:21.860135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:21.861255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.933418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1115/2216] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:21.945192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:21.946778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:21.959563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:22.029739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.032059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:22.046936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8f33-bb65-470f-a00d-ac0fbfabf8bf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.047935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2fe6d-974b-437c-bf3f-4e313d6f32c9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.053871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.054053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.054606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.054944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.055280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.055392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.055576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.055996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] PATH_INFO: `/v3/projects/d0aa42e32f244253a39d353d4aa6545e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.057263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0aa42e32f244253a39d353d4aa6545e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.059651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.083665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.085942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.101749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1102/2217] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:22.128071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0aa42e32f244253a39d353d4aa6545e', 'request_id': 'req-094ff784-d95e-4389-b4ce-e41d83da5755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.136768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0aa42e32f244253a39d353d4aa6545e', 'request_id': 'req-094ff784-d95e-4389-b4ce-e41d83da5755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.149700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0aa42e32f244253a39d353d4aa6545e', 'request_id': 'req-094ff784-d95e-4389-b4ce-e41d83da5755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.171371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] The token cache is being invalidate because project d0aa42e32f244253a39d353d4aa6545e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:22.171663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.172392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.174242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1116/2218] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:22 2022] DELETE /identity/v3/projects/d0aa42e32f244253a39d353d4aa6545e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:22.179108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.189976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985517c-e9f8-41d0-a0e9-e12ee65b61a7 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.255867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.256429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.256702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.256971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] PATH_INFO: `/v3/users/b6c626b40ac445c2846a2d16b50db992` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.258163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c626b40ac445c2846a2d16b50db992)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.260128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.322563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c626b40ac445c2846a2d16b50db992'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.329701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c626b40ac445c2846a2d16b50db992'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.330384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c626b40ac445c2846a2d16b50db992'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.344471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c626b40ac445c2846a2d16b50db992'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.354237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-294303b2-f2ca-4c9d-9da1-fa56e7c05be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c626b40ac445c2846a2d16b50db992'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.366214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1103/2219] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:22 2022] DELETE /identity/v3/users/b6c626b40ac445c2846a2d16b50db992 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:22.440370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.441993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:22.460287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff784-d95e-4389-b4ce-e41d83da5755 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.550697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.551651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.552162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.552765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] PATH_INFO: `/v3/projects/e0196019d5a44f42a08e6ef4a0584b50` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.553907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0196019d5a44f42a08e6ef4a0584b50)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.556043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.586113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:22.612336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0196019d5a44f42a08e6ef4a0584b50', 'request_id': 'req-17b9be88-b249-4e64-b026-327f9a5abd1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.619388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0196019d5a44f42a08e6ef4a0584b50', 'request_id': 'req-17b9be88-b249-4e64-b026-327f9a5abd1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.625237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0196019d5a44f42a08e6ef4a0584b50', 'request_id': 'req-17b9be88-b249-4e64-b026-327f9a5abd1b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.641976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] The token cache is being invalidate because project e0196019d5a44f42a08e6ef4a0584b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:22.642266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.642896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-17b9be88-b249-4e64-b026-327f9a5abd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:22.644527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1117/2220] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:22 2022] DELETE /identity/v3/projects/e0196019d5a44f42a08e6ef4a0584b50 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:22.652526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200767ef-7315-4727-aaca-8293896342d6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.655231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200767ef-7315-4727-aaca-8293896342d6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.655516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200767ef-7315-4727-aaca-8293896342d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.679392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-200767ef-7315-4727-aaca-8293896342d6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:22.680651 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-200767ef-7315-4727-aaca-8293896342d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:22.725356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:22.771699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1104/2221] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:22.780636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.781130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.781552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.812263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:22.818732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:22.823903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1118/2222] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:22.828336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200767ef-7315-4727-aaca-8293896342d6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.842560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200767ef-7315-4727-aaca-8293896342d6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.850424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.852224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.852970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.853721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.854606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:22.855108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.859186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.874883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1105/2223] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:22.880794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.892992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ffe1-2118-40ac-a310-92e23bf691e8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:22.899250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:22.900151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:22.900612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:22.901062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:22.902470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:22.905882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:22.947345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1119/2224] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:22 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:22.951747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:22.963115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38cc5a-b644-4eeb-8421-c7f2a70eb4c5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.036533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.037680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.038348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.038913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.040244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.043380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.077988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1106/2225] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:22 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:23.085234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:23.100057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0c8ab-6216-4d50-b362-ffd907983449 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.112057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.112748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.115134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.115439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.116291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.118014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.134366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1120/2226] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:23.135869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:23.146822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0f8d6-d682-40a0-ac00-a4e6a051b97b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.155924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:23.156518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.157260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.157572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.158179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.158295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:23.159020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.160944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.175888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618c55-dd83-4349-8a44-a147d04e69d1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.178166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1107/2227] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:23.182217 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:23.188534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.189205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.189474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.189886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] PATH_INFO: `/v3/projects/d05cc5fa56864ee3b4d79a1e70fa08c6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.191261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05cc5fa56864ee3b4d79a1e70fa08c6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.194640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.197925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422b7d-c890-459f-bae7-8b424eadb2b4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.207553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.209814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.210387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.210858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] PATH_INFO: `/v3/projects/b1f0131713d243dcb8e4e1101e806d91/users/eedc522f458848a9b07c70fc3572a903/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.237154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f0131713d243dcb8e4e1101e806d91, user_id=eedc522f458848a9b07c70fc3572a903, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.240844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eb849-d5e0-427d-b88b-be9c166cff8d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.264369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1108/2228] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:23 2022] PUT /identity/v3/projects/b1f0131713d243dcb8e4e1101e806d91/users/eedc522f458848a9b07c70fc3572a903/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:23.276674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.277031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.278957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.286366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05cc5fa56864ee3b4d79a1e70fa08c6', 'request_id': 'req-931de307-1dc0-4ab4-a200-91c626bf4682'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.314835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05cc5fa56864ee3b4d79a1e70fa08c6', 'request_id': 'req-931de307-1dc0-4ab4-a200-91c626bf4682'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.324911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05cc5fa56864ee3b4d79a1e70fa08c6', 'request_id': 'req-931de307-1dc0-4ab4-a200-91c626bf4682'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.335846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] MFA Rules not processed for user `eedc522f458848a9b07c70fc3572a903`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:23.337139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:23.345152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] The token cache is being invalidate because project d05cc5fa56864ee3b4d79a1e70fa08c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:23.345495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.346218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.347998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1121/2229] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:23 2022] DELETE /identity/v3/projects/d05cc5fa56864ee3b4d79a1e70fa08c6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:23.352507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:23.354125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:23.460567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:23.488639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de307-1dc0-4ab4-a200-91c626bf4682 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:23.539729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1109/2230] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:23.631445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:23.632767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:23.633371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:23.633796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] PATH_INFO: `/v3/users/cd9180708050405593ce29183072cfe8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:23.636010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9180708050405593ce29183072cfe8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:23.638298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:23.719664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9180708050405593ce29183072cfe8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.721390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9180708050405593ce29183072cfe8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.741661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9180708050405593ce29183072cfe8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.750898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9180708050405593ce29183072cfe8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.762104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9180708050405593ce29183072cfe8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:23.768952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1122/2231] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:23 2022] DELETE /identity/v3/users/cd9180708050405593ce29183072cfe8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:24.077201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:24.084096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:24.096454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7f622-2c25-4c80-8fd6-f90076157ccd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:24.177323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:24.178117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:24.178522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:24.178800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] PATH_INFO: `/v3/projects/435a2ab170594272b0a1279ba55d5551` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:24.180766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435a2ab170594272b0a1279ba55d5551)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:24.183322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:24.239948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435a2ab170594272b0a1279ba55d5551', 'request_id': 'req-9c8cc884-d6ac-4616-9100-20186fbe3904'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:24.247387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435a2ab170594272b0a1279ba55d5551', 'request_id': 'req-9c8cc884-d6ac-4616-9100-20186fbe3904'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:24.252829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435a2ab170594272b0a1279ba55d5551', 'request_id': 'req-9c8cc884-d6ac-4616-9100-20186fbe3904'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:24.263752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] The token cache is being invalidate because project 435a2ab170594272b0a1279ba55d5551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:24.264124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:24.264749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9c8cc884-d6ac-4616-9100-20186fbe3904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:24.266256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1110/2232] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:24 2022] DELETE /identity/v3/projects/435a2ab170594272b0a1279ba55d5551 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:25.204559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:25.205982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:25.218765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd40a-347c-4b2e-bdd9-405885c3ad18 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:25.281216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:25.282026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:25.282353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:25.282672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] PATH_INFO: `/v3/users/2d66083a743d4699ac09e3435c8856f8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:25.283999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d66083a743d4699ac09e3435c8856f8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:25.287133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:25.314224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:25.340808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d66083a743d4699ac09e3435c8856f8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.341475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d66083a743d4699ac09e3435c8856f8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.353548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d66083a743d4699ac09e3435c8856f8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.360488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d66083a743d4699ac09e3435c8856f8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.368387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d66083a743d4699ac09e3435c8856f8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.374350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1123/2233] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:25 2022] DELETE /identity/v3/users/2d66083a743d4699ac09e3435c8856f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:25.378991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:25.380152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:25.380310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:25.400713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:25.401943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:25.467041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1111/2234] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:25.478699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:25.481849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:25.559075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276af1-3356-43f8-911d-4994e24843d2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:25.564003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:25.564979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:25.565455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:25.565976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:25.577244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:25.578684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:25.588708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1124/2235] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:25.875799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:25.877059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:25.890354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a619-73f7-4d2a-a3da-b0d75d5af98a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:25.897176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:25.897834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:25.898113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:25.898388 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] PATH_INFO: `/v3/projects/936c7c12463f4076beb658242fd0f31d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:25.899719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936c7c12463f4076beb658242fd0f31d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:25.901678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:25.948052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:25.973254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936c7c12463f4076beb658242fd0f31d', 'request_id': 'req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.982795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936c7c12463f4076beb658242fd0f31d', 'request_id': 'req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:25.989418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936c7c12463f4076beb658242fd0f31d', 'request_id': 'req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.003626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] The token cache is being invalidate because project 936c7c12463f4076beb658242fd0f31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:26.003979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.005334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.008022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1112/2236] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:25 2022] DELETE /identity/v3/projects/936c7c12463f4076beb658242fd0f31d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:26.011253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.021634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb942-3373-43cc-8eb2-527dd32f5820 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.095802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.096658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.096932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.097202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] PATH_INFO: `/v3/users/9f13cedb3f3f4c3ebffc945d5aff8c9c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.101656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f13cedb3f3f4c3ebffc945d5aff8c9c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.103789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:26.151768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:26.154465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f13cedb3f3f4c3ebffc945d5aff8c9c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.155279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f13cedb3f3f4c3ebffc945d5aff8c9c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.171177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f13cedb3f3f4c3ebffc945d5aff8c9c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.179353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f13cedb3f3f4c3ebffc945d5aff8c9c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.187936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8f253c5a-50c0-42ca-af7a-b89d23350f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f13cedb3f3f4c3ebffc945d5aff8c9c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.194257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1125/2237] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:26 2022] DELETE /identity/v3/users/9f13cedb3f3f4c3ebffc945d5aff8c9c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:26.476425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.477852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:26.491109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c799e3-23c3-4f10-9ef5-3e10a240f9f5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.549971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.550606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.550883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.551153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] PATH_INFO: `/v3/projects/d4909b10b2024840ab95f65ae719d3a2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.552411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4909b10b2024840ab95f65ae719d3a2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.554466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:26.605120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4909b10b2024840ab95f65ae719d3a2', 'request_id': 'req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.619183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4909b10b2024840ab95f65ae719d3a2', 'request_id': 'req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.625025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4909b10b2024840ab95f65ae719d3a2', 'request_id': 'req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.636919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] The token cache is being invalidate because project d4909b10b2024840ab95f65ae719d3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:26.637201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.637840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d12a95b-c8c5-42e5-9b2f-10b4816aad92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:26.639347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1113/2238] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:26 2022] DELETE /identity/v3/projects/d4909b10b2024840ab95f65ae719d3a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:26.644613 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.645744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.645855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.669960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:26.671232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:26.737576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1126/2239] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:26.745598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.745879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.746176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.766306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:26.767501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:26.777942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1114/2240] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:05:26.782189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.792551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fec4b-f5cc-450e-93fb-598552f91c0d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.797303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.797907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.798180 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.798448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.799132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:26.799432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.801045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:26.813658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1127/2241] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:26.818616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.828798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309445-b509-448e-bf54-c9da2257bafc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.834845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.835471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.835748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.836052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.836722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.838610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:26.866974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1115/2242] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:26 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:26.870962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.881106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b0dd2-fc4d-4473-8af3-df8f8819b328 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.943378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.944051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.944327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.944595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.945264 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.947170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:26.968419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1128/2243] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:26 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:05:26.972812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:26.983668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e25d2-b6b1-4038-96d8-9bddaf044bf1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:26.989930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:26.990715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:26.990990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:26.991287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:26.992055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:26.993653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:27.004592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1116/2244] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:27.009714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:27.020351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4bdd-263c-47f2-879d-593425b33d45 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:27.025339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:27.025951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:27.026246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:27.026499 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:27.027193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:27.028822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb1156-b7c8-4281-a0c8-3f1b7752291c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:27.041435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1129/2245] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:27.045971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:27.056822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924a054-392a-4ab8-a7f6-2da6f80feb80 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:27.061501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:27.062158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:27.062444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:27.062714 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] PATH_INFO: `/v3/projects/d9667dd2533c4b2b92883a02896b1694/users/f0bee31900394e1ebe82136ceeb88091/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:27.064966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:27.079994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9667dd2533c4b2b92883a02896b1694, user_id=f0bee31900394e1ebe82136ceeb88091, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:27.082687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:27.095170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1117/2246] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:27 2022] PUT /identity/v3/projects/d9667dd2533c4b2b92883a02896b1694/users/f0bee31900394e1ebe82136ceeb88091/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:05:27.100840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46343d2-1814-4617-8b63-a30bd6186d7f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:27.101130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46343d2-1814-4617-8b63-a30bd6186d7f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:27.101433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46343d2-1814-4617-8b63-a30bd6186d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:27.122502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e46343d2-1814-4617-8b63-a30bd6186d7f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:27.123843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e46343d2-1814-4617-8b63-a30bd6186d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:27.149619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:27.204082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1130/2247] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:27.210735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:27.212529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:27.285316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b238a6-562d-4f7a-a18e-cb09193794e4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:27.290356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:27.291003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:27.291285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:27.291551 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:27.302235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:27.304082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:27.316674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1118/2248] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:05:28.445816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:28.446394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:28.446394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:28.483077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] MFA Rules not processed for user `f0bee31900394e1ebe82136ceeb88091`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:28.484250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:28.592750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1131/2249] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:28.605234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:28.607355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:28.698725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd28fb-fe3f-43eb-9dad-1a027e3a987e service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:28.702629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:28.703373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:28.703711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:28.704081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:28.714295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:28.715895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda31c1-0f42-4e74-b76f-ba013e83b8a8 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:28.728208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1119/2250] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:29.111580 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:29.111969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:29.180582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545db99-b978-4079-80d1-2870d6fea3b0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:29.184667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:29.185287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:29.185563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:29.185886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:29.187855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:29.253447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:29.255476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:29.264628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1132/2251] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:30.187342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:30.187970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:30.188320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:30.209415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] MFA Rules not processed for user `f0bee31900394e1ebe82136ceeb88091`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:30.211075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:30.222316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1120/2252] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:31.378048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:31.380182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:31.398031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86886-7615-4241-917d-e639da041e86 service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:31.403397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:31.404126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:31.404409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:31.404756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] PATH_INFO: `/v3/users/083840b9867145389ebf9cb035f0aba1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:31.406155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083840b9867145389ebf9cb035f0aba1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:31.408111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:31.419825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:31.501854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083840b9867145389ebf9cb035f0aba1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.503402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083840b9867145389ebf9cb035f0aba1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.521297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083840b9867145389ebf9cb035f0aba1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.531531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083840b9867145389ebf9cb035f0aba1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.546838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41ed931a-5785-46a3-bfd6-f8f772b5a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083840b9867145389ebf9cb035f0aba1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.558089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1133/2253] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:31 2022] DELETE /identity/v3/users/083840b9867145389ebf9cb035f0aba1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:31.762481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:31.790475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876de57-5458-46d6-b62b-dbd34792689b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:31.864507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:31.865169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:31.865957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:31.865957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] PATH_INFO: `/v3/projects/2d9f205b7bd747c7b51ff51aa328a3cc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:31.866919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9f205b7bd747c7b51ff51aa328a3cc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:31.868856 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:31.896742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:31.922159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9f205b7bd747c7b51ff51aa328a3cc', 'request_id': 'req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.930769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9f205b7bd747c7b51ff51aa328a3cc', 'request_id': 'req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.936292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9f205b7bd747c7b51ff51aa328a3cc', 'request_id': 'req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.948324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] The token cache is being invalidate because project 2d9f205b7bd747c7b51ff51aa328a3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:31.948612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.949247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b0a6f4a3-070f-445b-a9a4-afacefb1b89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:31.950825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1121/2254] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:31 2022] DELETE /identity/v3/projects/2d9f205b7bd747c7b51ff51aa328a3cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:31.956323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:31.956675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:31.957015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:31.980182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:31.981755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:32.051506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1134/2255] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:32.059699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.060020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.060300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.080762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:32.082237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:32.091331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1122/2256] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:32.095691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.106117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fef9e-2c3b-4ac2-8aa4-55d2805b8084 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.110935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.111535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.111844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.112122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.112817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:05:32.113120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.114844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.127257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1135/2257] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:05:32.131899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.141272 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb607cf-fa3c-44fe-ab5b-4d2433874346 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.146487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.147087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.147364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.147634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.148330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.150205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.178200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1123/2258] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:05:32 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:32.182893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.194758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74862335-4a1d-495b-bbff-d8370a17f863 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.255880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.256780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.257194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.257467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.258277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.260243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.278125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:32.283528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1136/2259] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:05:32 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:05:32.288791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.299062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac9d37-b2c5-41ff-8385-6aedf6395c3d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.304346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.304669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.304948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.305215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.305956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.308032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.320968 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1124/2260] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:05:32.324843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.335468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a826-5d33-4d53-9fb3-00d8d365f9b1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.340372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.340963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.341296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.341651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.342862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.348413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72fe6-f140-4659-9a4c-c15a8670463a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.357875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1137/2261] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:05:32.362295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.375168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb30ea-f10b-4d85-a22c-2655f599f5a3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.380278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.380937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.381208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.381492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] PATH_INFO: `/v3/projects/573a75f13f7240479c725daba27011bf/users/10705004cfd74f0caddef9db51f1a52c/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.401153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573a75f13f7240479c725daba27011bf, user_id=10705004cfd74f0caddef9db51f1a52c, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.403874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.429583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1125/2262] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:05:32 2022] PUT /identity/v3/projects/573a75f13f7240479c725daba27011bf/users/10705004cfd74f0caddef9db51f1a52c/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:32.433997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015838-b12b-4f4e-9f67-1be46b7a0707 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.433997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015838-b12b-4f4e-9f67-1be46b7a0707 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.433997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015838-b12b-4f4e-9f67-1be46b7a0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.452922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5d015838-b12b-4f4e-9f67-1be46b7a0707 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:32.454256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5d015838-b12b-4f4e-9f67-1be46b7a0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:32.525058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1138/2263] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:32.535128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:32.537009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:32.599593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7ec3-b7e7-455a-a624-fcce81553a99 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:32.603631 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:32.604345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:32.604626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:32.604898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:32.616064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:32.617509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18265a9f-ad9b-45a6-8f1d-f5fe54230e02 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:32.627959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1126/2264] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:37.812777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:37.813219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:37.813380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:37.852184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] MFA Rules not processed for user `10705004cfd74f0caddef9db51f1a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:37.853414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:37.937679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1139/2265] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:37.950457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66da6-b5c8-4479-8dc4-89871346cba8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:37.950982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66da6-b5c8-4479-8dc4-89871346cba8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:37.951168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66da6-b5c8-4479-8dc4-89871346cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:37.971683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7df66da6-b5c8-4479-8dc4-89871346cba8 None None] MFA Rules not processed for user `10705004cfd74f0caddef9db51f1a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:37.972914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7df66da6-b5c8-4479-8dc4-89871346cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:37.981153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1127/2266] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:38.003205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:38.006419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:38.101853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2ef7-498e-450f-8949-86ac1f37d2e6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:38.107401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:38.108200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:38.108475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:38.108776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:38.118188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:38.119763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:38.130296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1140/2267] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:38.841174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281b89-d664-4e97-96b7-89507417ae91 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:38.841466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281b89-d664-4e97-96b7-89507417ae91 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:38.841740 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281b89-d664-4e97-96b7-89507417ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:38.862586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ef281b89-d664-4e97-96b7-89507417ae91 None None] MFA Rules not processed for user `10705004cfd74f0caddef9db51f1a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:38.863915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ef281b89-d664-4e97-96b7-89507417ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:38.871222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1128/2268] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:48.125254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:48.859915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=74,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:49.065424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:49.067394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:49.081943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6656d0e-c83e-4bfe-bf41-46851f54f461 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:49.087173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:49.087871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:49.088150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:49.088422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] PATH_INFO: `/v3/users/463df0a53ab44e47a97a479d77984e20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:49.089589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463df0a53ab44e47a97a479d77984e20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:49.091485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:49.144507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463df0a53ab44e47a97a479d77984e20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.145780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463df0a53ab44e47a97a479d77984e20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.161054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463df0a53ab44e47a97a479d77984e20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.167851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463df0a53ab44e47a97a479d77984e20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.176054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463df0a53ab44e47a97a479d77984e20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.183450 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1141/2269] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:05:49 2022] DELETE /identity/v3/users/463df0a53ab44e47a97a479d77984e20 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:49.188562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:49.188849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:49.189129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:49.208432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:49.209625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:49.272055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1129/2270] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:49.281856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:49.283374 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:49.347848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f689d-9974-4ca7-b787-1ce1c0d6cad6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:49.351936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:49.352558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:49.352837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:49.353110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:49.362428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:49.364513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402724ab-c39a-4c50-bef0-be8a033d90b5 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:49.376518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1142/2271] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:05:49.670923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:05:49.672453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:49.688818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1bdf-5480-48e2-915f-be3ee5d335d5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:05:49.693439 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:05:49.694356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:49.694712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:49.695086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] PATH_INFO: `/v3/projects/f3e5e62a505140e0875118996b9fa904` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:49.696555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e5e62a505140e0875118996b9fa904)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:05:49.698964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:05:49.805948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e5e62a505140e0875118996b9fa904', 'request_id': 'req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.819066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e5e62a505140e0875118996b9fa904', 'request_id': 'req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.831823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e5e62a505140e0875118996b9fa904', 'request_id': 'req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.844571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] The token cache is being invalidate because project f3e5e62a505140e0875118996b9fa904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:05:49.845584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.846299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:05:49.855846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1130/2272] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:05:49 2022] DELETE /identity/v3/projects/f3e5e62a505140e0875118996b9fa904 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:05:58.048779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bd7c8-d413-4d5c-a2a6-20f08c24a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:05:58.049224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bd7c8-d413-4d5c-a2a6-20f08c24a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:05:58.049314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bd7c8-d413-4d5c-a2a6-20f08c24a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:05:58.072394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-526bd7c8-d413-4d5c-a2a6-20f08c24a2a9 None None] MFA Rules not processed for user `f0bee31900394e1ebe82136ceeb88091`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:05:58.074105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-526bd7c8-d413-4d5c-a2a6-20f08c24a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:05:58.136733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1143/2273] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:05:59.845060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:04.768076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:04.769515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:04.840980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed32e0-c05d-4ba0-987a-ea003bf95e7d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:04.845586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:04.846215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:04.846492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:04.846761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] PATH_INFO: `/v3/users/d5426a47d6434f35bb7a998dcc1f6fe6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:04.848526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5426a47d6434f35bb7a998dcc1f6fe6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:04.850531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:04.901117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5426a47d6434f35bb7a998dcc1f6fe6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:04.908032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5426a47d6434f35bb7a998dcc1f6fe6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:04.908694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5426a47d6434f35bb7a998dcc1f6fe6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:04.922384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5426a47d6434f35bb7a998dcc1f6fe6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:04.931703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5426a47d6434f35bb7a998dcc1f6fe6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:04.939473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1131/2274] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:06:04 2022] DELETE /identity/v3/users/d5426a47d6434f35bb7a998dcc1f6fe6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:04.946045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:04.946549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:04.946641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:04.965089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:04.966463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:04.980454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:05.030628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1144/2275] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:06:05.040531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.041901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:05.104225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5d3c-2a1f-4549-b575-65ac5ef73696 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.108138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.108879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.109198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.109464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.120121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.121526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63760269-2c0b-4893-868a-c74724e9d6c5 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.130935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1132/2276] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:05.411747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.413565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:05.426449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e9e2-9387-498d-9ae1-761d9e01cef4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.431115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.431760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.432074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.432342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] PATH_INFO: `/v3/projects/bd9ef2c5c02b4aceab99350f591e9d49` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.433519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9ef2c5c02b4aceab99350f591e9d49)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.435404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.487871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9ef2c5c02b4aceab99350f591e9d49', 'request_id': 'req-80e645db-ef56-4135-9e20-b98668fac159'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:05.494769 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9ef2c5c02b4aceab99350f591e9d49', 'request_id': 'req-80e645db-ef56-4135-9e20-b98668fac159'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:05.500165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9ef2c5c02b4aceab99350f591e9d49', 'request_id': 'req-80e645db-ef56-4135-9e20-b98668fac159'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:05.513525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] The token cache is being invalidate because project bd9ef2c5c02b4aceab99350f591e9d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:06:05.513937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:05.514578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-80e645db-ef56-4135-9e20-b98668fac159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:05.516229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1145/2277] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:06:05 2022] DELETE /identity/v3/projects/bd9ef2c5c02b4aceab99350f591e9d49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:05.521575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558202d8-592b-4001-86c7-be2c45039243 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.521855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558202d8-592b-4001-86c7-be2c45039243 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.522128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558202d8-592b-4001-86c7-be2c45039243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.541900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-558202d8-592b-4001-86c7-be2c45039243 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:05.543098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-558202d8-592b-4001-86c7-be2c45039243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:05.560492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:05.610106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1133/2278] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:05.619129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.619412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.619683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.640162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:05.641565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:05.655732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1146/2279] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:06:05.656935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558202d8-592b-4001-86c7-be2c45039243 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.668767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558202d8-592b-4001-86c7-be2c45039243 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.674050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.674954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.675307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.675641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.676655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:06:05.677028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.678727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.690936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1134/2280] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:06:05.695468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.705555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fdf64-994c-45eb-a0ab-5ac6f2f38ffe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.712068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.712701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.713007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.713278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.714049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.715916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.757103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1147/2281] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:06:05 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:06:05.758249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.768867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bffc3f-dffb-43aa-afbd-72b403d0e05b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.837373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.838034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.838387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.838729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.840139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.841875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.875422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1135/2282] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:06:05 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:06:05.875513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.887654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2a516-b68f-423c-a560-663f060cc36c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.892306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.892916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.893187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.893453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.894140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.896670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.910257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1148/2283] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:05.911262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.923138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb06e7b-6422-49af-a57f-d89ff8a609b5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.928491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.929110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.929390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.929662 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.930357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.931964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cec49-47ce-49b5-bd2a-bbabaa35327c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:05.944242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1136/2284] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:06:05.948439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:05.959953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc840cb-fbab-4f68-a346-9acb9d456b71 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:05.966101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:05.966776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:05.967081 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:05.967428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] PATH_INFO: `/v3/projects/ced22cac760c43579905ea83f6b42ee3/users/f916636d41e34b51a3411c5a1fece34a/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:05.983470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced22cac760c43579905ea83f6b42ee3, user_id=f916636d41e34b51a3411c5a1fece34a, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:05.986550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:06.003465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1149/2285] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:06:05 2022] PUT /identity/v3/projects/ced22cac760c43579905ea83f6b42ee3/users/f916636d41e34b51a3411c5a1fece34a/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:06.014803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2432d6-5379-4c9e-ae30-9f4ec273b7fd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:06.015086 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2432d6-5379-4c9e-ae30-9f4ec273b7fd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:06.015357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2432d6-5379-4c9e-ae30-9f4ec273b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:06.049432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5a2432d6-5379-4c9e-ae30-9f4ec273b7fd None None] MFA Rules not processed for user `f916636d41e34b51a3411c5a1fece34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:06.050600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5a2432d6-5379-4c9e-ae30-9f4ec273b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:06.116114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1137/2286] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:06.126841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:06.128557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:06.172890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:06.194423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd8a-dea3-4d4e-acbd-d4f7b2fe83e0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:06.198031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:06.198642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:06.198914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:06.199181 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:06.207831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:06.209471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:06.218953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1150/2287] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:07.583457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50e313-f4b1-4352-bd06-b7123e00d34f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:07.584271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50e313-f4b1-4352-bd06-b7123e00d34f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:07.584549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50e313-f4b1-4352-bd06-b7123e00d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:07.608666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ab50e313-f4b1-4352-bd06-b7123e00d34f None None] MFA Rules not processed for user `f916636d41e34b51a3411c5a1fece34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:07.610193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ab50e313-f4b1-4352-bd06-b7123e00d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:07.639089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1138/2288] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:09.315751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:09.317212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:09.385220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fc413-304b-4622-b7f6-85af61f627eb service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:09.389767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:09.390400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:09.390674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:09.390942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] PATH_INFO: `/v3/users/eedc522f458848a9b07c70fc3572a903` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:09.392122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedc522f458848a9b07c70fc3572a903)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:09.394024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:09.452365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedc522f458848a9b07c70fc3572a903'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:09.453118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedc522f458848a9b07c70fc3572a903'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:09.467963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedc522f458848a9b07c70fc3572a903'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:09.476549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedc522f458848a9b07c70fc3572a903'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:09.485042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedc522f458848a9b07c70fc3572a903'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:09.491578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1151/2289] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:06:09 2022] DELETE /identity/v3/users/eedc522f458848a9b07c70fc3572a903 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:09.496089 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:09.496584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:09.496694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:09.516015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:09.517190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:09.523488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:09.583927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1139/2290] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:09.595002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:09.596503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:09.666681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9174a2-1542-4515-93a2-4bff4611b66e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:09.670661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:09.671280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:09.671557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:09.671993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:09.683010 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:09.684463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea659-77b3-4a35-98f6-356623046d7b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:09.694801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1152/2291] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:10.134865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.136537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:10.167866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000fe00-0004-4b2e-9c58-1798c0ab91de None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.186866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.188292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.188912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.189409 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] PATH_INFO: `/v3/projects/b1f0131713d243dcb8e4e1101e806d91` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.192610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f0131713d243dcb8e4e1101e806d91)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.198328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.288387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f0131713d243dcb8e4e1101e806d91', 'request_id': 'req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:10.297727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f0131713d243dcb8e4e1101e806d91', 'request_id': 'req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:10.305035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f0131713d243dcb8e4e1101e806d91', 'request_id': 'req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:10.318525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] The token cache is being invalidate because project b1f0131713d243dcb8e4e1101e806d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:06:10.318882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:10.319498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fd7ce6cd-48f1-4ccd-85c0-96e6e9fee932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:10.321744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1140/2292] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:06:10 2022] DELETE /identity/v3/projects/b1f0131713d243dcb8e4e1101e806d91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:10.326957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.327526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.327526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.339135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:10.353008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:10.354593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:10.437117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1153/2293] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:10.446288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.446855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.447126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.467725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:10.470003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:10.479233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1141/2294] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:10.483917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.496954 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02270-fb39-4c44-86c1-13ec696916bb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.518509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.519055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.519407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.519742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.521362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:06:10.521680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.523284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.541827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.553525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6387b-cb2b-4585-9f69-7b82835db460 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.555057 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1154/2295] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:06:10.572415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.573115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.573391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.574006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.574991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.576980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.608454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1142/2296] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:06:10 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:06:10.612685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.629803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc26ec1-9617-49f4-83ce-77428646421f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.702021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.702682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.702955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.703219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.703919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.709941 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.749850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1155/2297] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:06:10 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:06:10.755910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.770704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc876-433e-4af1-bacc-394c7608e512 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.777339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.778734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.778734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.779079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.780012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.781796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.799970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1143/2298] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:10.800463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.812617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c025c5-e1a7-4815-8828-ac8d547fa6bd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.818639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.819362 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.819768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.820165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.820985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.822746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4c4a-fda5-4b46-8058-df8b24e33a21 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.846969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1156/2299] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:10.857051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:10.868323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80baea6-dcf6-43ad-bf6c-e7c32459d1a9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:10.873676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:10.874065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.874358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.874619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] PATH_INFO: `/v3/projects/2dee83d876004cac86b9d4d74ff3eb2d/users/b4e847f56b6b443cbe3768880678b13b/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.893033 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dee83d876004cac86b9d4d74ff3eb2d, user_id=b4e847f56b6b443cbe3768880678b13b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:10.897410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:10.915188 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1144/2300] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:06:10 2022] PUT /identity/v3/projects/2dee83d876004cac86b9d4d74ff3eb2d/users/b4e847f56b6b443cbe3768880678b13b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:10.926858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122ba7-3bee-48d0-96e2-21e079a369a6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:10.927249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122ba7-3bee-48d0-96e2-21e079a369a6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:10.927551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122ba7-3bee-48d0-96e2-21e079a369a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:10.982365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-91122ba7-3bee-48d0-96e2-21e079a369a6 None None] MFA Rules not processed for user `b4e847f56b6b443cbe3768880678b13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:10.984001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-91122ba7-3bee-48d0-96e2-21e079a369a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:11.111453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:11.122009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1157/2301] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:11.134019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:11.136546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:11.187494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:11.237473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e80e-913c-4bd9-a687-341f022f57f4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:11.241909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:11.242537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:11.243632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:11.244016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:11.254698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:11.256545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:11.266877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1145/2302] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:06:21.262126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=12 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:33.472175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:33.472699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:33.473526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:33.496174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:33.497550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:33.563806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1158/2303] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:33.617171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:33.618764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:33.690847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3734b-874a-4643-a917-6e5f3e980eff service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:33.696413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:33.697039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:33.697314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:33.697646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:33.710470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:33.712100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db96454-e8eb-4ae9-beee-e750820b5f55 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:33.720705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1146/2304] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:33.930614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:34.029040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d31b3-70a0-41d4-9828-afa0ae7bc675 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:34.039096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:34.040278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:34.040766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:34.041228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] PATH_INFO: `/v3/users/b4e847f56b6b443cbe3768880678b13b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:34.044199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e847f56b6b443cbe3768880678b13b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:34.046759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:34.108763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e847f56b6b443cbe3768880678b13b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:34.109577 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e847f56b6b443cbe3768880678b13b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:34.127495 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e847f56b6b443cbe3768880678b13b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:34.136852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e847f56b6b443cbe3768880678b13b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:34.146915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e847f56b6b443cbe3768880678b13b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:34.154296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1159/2305] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:06:33 2022] DELETE /identity/v3/users/b4e847f56b6b443cbe3768880678b13b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:34.159164 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c811-233d-482e-a969-944f66765482 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:34.159721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c811-233d-482e-a969-944f66765482 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:34.159721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c811-233d-482e-a969-944f66765482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:34.181567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4f96c811-233d-482e-a969-944f66765482 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:34.182882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4f96c811-233d-482e-a969-944f66765482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:34.256257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1147/2306] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:34.266005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:34.269296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:34.315256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:34.355449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cbce-c780-4aec-89a6-09ef8719dba0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:34.369156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:34.370411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:34.370737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:34.371014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:34.385392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:34.386964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b0ce-8fac-427e-a0b7-e516644a8859 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:34.406862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1160/2307] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:35.021991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96c811-233d-482e-a969-944f66765482 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.023554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4f96c811-233d-482e-a969-944f66765482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:35.046108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96c811-233d-482e-a969-944f66765482 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.052440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.054137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.054591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.054866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] PATH_INFO: `/v3/projects/2dee83d876004cac86b9d4d74ff3eb2d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.057350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dee83d876004cac86b9d4d74ff3eb2d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.059377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.127709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dee83d876004cac86b9d4d74ff3eb2d', 'request_id': 'req-c1b20ca1-9452-4e5a-a634-ef5d0120df87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:35.138711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dee83d876004cac86b9d4d74ff3eb2d', 'request_id': 'req-c1b20ca1-9452-4e5a-a634-ef5d0120df87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:35.147547 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dee83d876004cac86b9d4d74ff3eb2d', 'request_id': 'req-c1b20ca1-9452-4e5a-a634-ef5d0120df87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:35.171483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] The token cache is being invalidate because project 2dee83d876004cac86b9d4d74ff3eb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:06:35.172101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:35.173093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c1b20ca1-9452-4e5a-a634-ef5d0120df87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:06:35.176573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1148/2308] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:06:35 2022] DELETE /identity/v3/projects/2dee83d876004cac86b9d4d74ff3eb2d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:35.182111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.183269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.183549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.206330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:35.209015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:35.301292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1161/2309] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:35.310480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.311116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.311384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.335224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:35.336468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:35.346885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1149/2310] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:35.351485 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.362154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789f3a-d0c9-4122-9385-2cf0cca7e275 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.370199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.371122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.374492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.374997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.375705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:06:35.376132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.377850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.393907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1162/2311] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:06:35.399567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.410098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7be57-a30e-4a33-9ccc-efeba0ea776b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.419201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.420039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.420736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.420736 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.421754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.424286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.432623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:35.461305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1150/2312] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:06:35 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:06:35.465245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.494566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585952-13ce-4c1a-aa9b-60d5be65ee29 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.572336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.573007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.573283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.573557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.574244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.578423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.618668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1163/2313] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:06:35 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:06:35.619962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.635999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dc60-d7af-4f01-81ce-fcd241d9da6c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.640967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.641715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.641990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.642261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.643055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.645130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.657543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1151/2314] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:06:35.662312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.686571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832322d-80a6-426c-be7e-e20a543c6c3b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.695676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.696528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.696883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.697227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.698389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.700123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d336-e909-41ea-9c34-d5f705383c5f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.712761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1164/2315] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:35.717214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.736340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7049-309b-44bc-b45d-4c1c1881c765 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:35.742407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:35.743202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.743585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.743956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] PATH_INFO: `/v3/projects/ec13d23d483b47f6b8f45c9aedea072a/users/69ccb4c3326c47a3ab69bbf5830ab1ef/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.765449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec13d23d483b47f6b8f45c9aedea072a, user_id=69ccb4c3326c47a3ab69bbf5830ab1ef, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:35.768705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:35.798301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1152/2316] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:06:35 2022] PUT /identity/v3/projects/ec13d23d483b47f6b8f45c9aedea072a/users/69ccb4c3326c47a3ab69bbf5830ab1ef/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:35.800133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558e09-8bf8-4946-a81a-3b9a9f3d2acf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:35.801115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558e09-8bf8-4946-a81a-3b9a9f3d2acf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:35.801448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558e09-8bf8-4946-a81a-3b9a9f3d2acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:35.835124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d558e09-8bf8-4946-a81a-3b9a9f3d2acf None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:35.836403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d558e09-8bf8-4946-a81a-3b9a9f3d2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:35.889790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:35.936216 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1165/2317] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:35.944278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:35.947013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:36.048222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f611b8-2bab-4875-93a0-22fa6f56b338 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:36.057593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:36.058323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:36.058634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:36.060973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:36.088712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:36.090775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd7d87-7052-4f2c-9c6a-74cc20aec4db service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:36.125987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1153/2318] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:39.458523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:39.458523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:39.458523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:39.517573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] MFA Rules not processed for user `67e79817ed9e40728f92a22053a24118`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:39.518867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:39.673608 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1166/2319] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:39.683668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9224-0a6e-44b1-b015-852a01f037ea None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:39.684677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9224-0a6e-44b1-b015-852a01f037ea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:39.685141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9224-0a6e-44b1-b015-852a01f037ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:39.718883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-212c9224-0a6e-44b1-b015-852a01f037ea None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:39.720228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-212c9224-0a6e-44b1-b015-852a01f037ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:39.823127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1154/2320] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:39.837930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:39.882566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:40.003129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf71dd-472b-4a19-8ce3-0bb9816ec4cc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:40.008717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:40.009435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:40.009776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:40.012282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:40.031246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:40.033718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:40.047952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1167/2321] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:45.041199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:45.041838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:45.041838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:45.096824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] MFA Rules not processed for user `69ccb4c3326c47a3ab69bbf5830ab1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:45.098725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:45.213281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:45.254965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1155/2322] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:45.259517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:45.272687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89f46-862e-46c5-9e72-483979f36b5b service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:45.283539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:45.284226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:45.284511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:45.284782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:45.286018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:45.289084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:45.465178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1168/2323] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:06:45 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:06:45.466913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:45.544994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbb50-5eab-4325-88ee-c3e894f936b3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:45.677297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:45.677940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:45.678504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:45.678779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:45.679455 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:45.683269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:45.727845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1156/2324] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:06:45 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:06:45.730983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:45.775103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1cfa2-c6ba-4548-9516-87b6658ad07d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:45.791651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:45.793856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:45.794510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:45.795046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:45.797086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:45.801753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:45.859228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1169/2325] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:45.860774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:45.874615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fb02f-6bd9-456a-95fb-14b10d2dbfda admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:45.880214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:45.881007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:45.881468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:45.881820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] PATH_INFO: `/v3/projects/eac96adcc17f424399f4d49990d21118/users/3fcb1bcc13744c0eb37670a8b9bfa04b/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:45.916176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac96adcc17f424399f4d49990d21118, user_id=3fcb1bcc13744c0eb37670a8b9bfa04b, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:45.919135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:45.951346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1157/2326] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:06:45 2022] PUT /identity/v3/projects/eac96adcc17f424399f4d49990d21118/users/3fcb1bcc13744c0eb37670a8b9bfa04b/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:45.952538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:45.964130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c94a98-2cc2-47a4-b2ad-150061941d0d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:46.057854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:46.107219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:46.107894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:46.108177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:46.108446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:46.109149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:46.110902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a164073-4b61-467f-9f9d-69ef753d0b0f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:46.128025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1170/2327] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:06:46.134384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:46.181863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94110f9-32c4-4c62-a98a-af5cf3344fcd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:46.211344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:46.212581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:46.213159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:46.213908 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] PATH_INFO: `/v3/projects/eac96adcc17f424399f4d49990d21118/users/3fcb1bcc13744c0eb37670a8b9bfa04b/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:46.216843 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac96adcc17f424399f4d49990d21118, user_id=3fcb1bcc13744c0eb37670a8b9bfa04b, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:46.219985 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:46.278522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1158/2328] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:06:46 2022] PUT /identity/v3/projects/eac96adcc17f424399f4d49990d21118/users/3fcb1bcc13744c0eb37670a8b9bfa04b/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:06:55.949353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e56-2839-4a51-9fae-01bd2ca1e9e9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:55.959221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e56-2839-4a51-9fae-01bd2ca1e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:55.959842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e56-2839-4a51-9fae-01bd2ca1e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:56.052894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d3530e56-2839-4a51-9fae-01bd2ca1e9e9 None None] MFA Rules not processed for user `3fcb1bcc13744c0eb37670a8b9bfa04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:56.054648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3530e56-2839-4a51-9fae-01bd2ca1e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:56.234210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=50,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:56.276515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1171/2329] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:56.406753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:56.409585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:56.596214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528fcb7-0c8f-4ddd-bf00-cde0c9d0f9bd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:56.603102 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:56.603769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:56.604082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:56.604351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:56.691466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:56.693476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:56.710148 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1159/2330] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:06:59.190827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6437a-1970-44c8-98ae-9d30cb487425 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:59.192858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6437a-1970-44c8-98ae-9d30cb487425 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:59.193257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6437a-1970-44c8-98ae-9d30cb487425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:59.231935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-19e6437a-1970-44c8-98ae-9d30cb487425 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:59.233382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19e6437a-1970-44c8-98ae-9d30cb487425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:59.352793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1172/2331] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:06:59.380852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:06:59.544414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb052f3-0440-4d0d-b3f3-fa8967ff26da service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:06:59.553739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:06:59.555326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:59.560044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:59.560728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:59.573963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:06:59.575657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363a5e8-c0da-459d-9746-5c9dcb0a1e70 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:06:59.592106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1160/2332] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:59.784335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:06:59.784552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:06:59.784966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:06:59.827934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] MFA Rules not processed for user `69ccb4c3326c47a3ab69bbf5830ab1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:06:59.829544 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:06:59.846262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1173/2333] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:00.977952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea66f7-f8de-422b-8230-7e64805b3c35 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:00.978840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea66f7-f8de-422b-8230-7e64805b3c35 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:00.979861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea66f7-f8de-422b-8230-7e64805b3c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:01.039858 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bcea66f7-f8de-422b-8230-7e64805b3c35 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:01.044075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bcea66f7-f8de-422b-8230-7e64805b3c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:01.076096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1161/2334] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:01.094943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:01.147889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf926ea-f5b2-4ef0-a5a7-a5ccd03affcd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:01.176663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:01.184640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:01.184928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:01.185206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:01.217074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:01.219266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:01.238904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1174/2335] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:01.669826 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3b21-5698-44d0-8c22-524319a6ce60 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:01.670262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3b21-5698-44d0-8c22-524319a6ce60 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:01.670812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3b21-5698-44d0-8c22-524319a6ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:01.704535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fe0d3b21-5698-44d0-8c22-524319a6ce60 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:01.706267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fe0d3b21-5698-44d0-8c22-524319a6ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:01.736058 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1162/2336] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:01.757141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:01.772191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f769ac-5820-444c-af09-8df592078f3f service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:01.778620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:01.779807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:01.780312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:01.780771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:01.797905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:01.799751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:01.822021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1175/2337] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:02.297334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4ac0-0f31-4354-aadf-8ac1b5cb34c3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:02.297892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4ac0-0f31-4354-aadf-8ac1b5cb34c3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:02.297892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4ac0-0f31-4354-aadf-8ac1b5cb34c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:02.337331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-451b4ac0-0f31-4354-aadf-8ac1b5cb34c3 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:02.338739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-451b4ac0-0f31-4354-aadf-8ac1b5cb34c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:02.346841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1163/2338] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:02.360507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:02.373004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd7d4-4484-49ae-b1fc-48aad0929b44 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:02.380102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:02.381691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:02.382182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:02.382896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:02.393136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:02.396038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:02.409818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1176/2339] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:02.994340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:02.994809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:02.995077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:03.011273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:03.025297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:03.026498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:03.039894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1164/2340] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:03.072967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:03.086273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bd3-1084-4518-b07c-83431177183c service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:03.092480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:03.093403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:03.093998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:03.094471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:03.105392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:03.107390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:03.118467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1177/2341] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:05.025472 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.028896 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.146648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389fb81-32d9-4493-a34d-1a573f1fff34 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.153415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.154390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.154674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.154994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] PATH_INFO: `/v3/users/f0bee31900394e1ebe82136ceeb88091` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.156419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bee31900394e1ebe82136ceeb88091)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.158332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:05.220356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bee31900394e1ebe82136ceeb88091'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.228942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bee31900394e1ebe82136ceeb88091'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.229698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bee31900394e1ebe82136ceeb88091'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.244153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bee31900394e1ebe82136ceeb88091'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.252898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bee31900394e1ebe82136ceeb88091'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.261020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1165/2342] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:07:05 2022] DELETE /identity/v3/users/f0bee31900394e1ebe82136ceeb88091 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:05.461104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.467164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:05.475974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d6bb2-5e8a-49ff-894a-1953ddcbd6b7 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.561445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.562087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.562363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.562634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] PATH_INFO: `/v3/projects/d9667dd2533c4b2b92883a02896b1694` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.563833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9667dd2533c4b2b92883a02896b1694)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.565733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:05.602219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.603881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.619812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f566-093b-4335-bd86-953fbf1847ab admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.621063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9667dd2533c4b2b92883a02896b1694', 'request_id': 'req-4032c183-682f-4127-af5d-001f63123adf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.629427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9667dd2533c4b2b92883a02896b1694', 'request_id': 'req-4032c183-682f-4127-af5d-001f63123adf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.636075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9667dd2533c4b2b92883a02896b1694', 'request_id': 'req-4032c183-682f-4127-af5d-001f63123adf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.651679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] The token cache is being invalidate because project d9667dd2533c4b2b92883a02896b1694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:07:05.652021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.652622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4032c183-682f-4127-af5d-001f63123adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.654307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1178/2343] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:07:05 2022] DELETE /identity/v3/projects/d9667dd2533c4b2b92883a02896b1694 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:05.659088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8327d0-a6ba-47cd-a33e-69d8a637a9e0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.659455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8327d0-a6ba-47cd-a33e-69d8a637a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.659998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8327d0-a6ba-47cd-a33e-69d8a637a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.682641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cb8327d0-a6ba-47cd-a33e-69d8a637a9e0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:05.683881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb8327d0-a6ba-47cd-a33e-69d8a637a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.688584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.688988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.689267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.689541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] PATH_INFO: `/v3/users/f916636d41e34b51a3411c5a1fece34a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.690774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f916636d41e34b51a3411c5a1fece34a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.693782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:05.694548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1179/2344] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:05.702050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.702311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.702581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.719837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:05.721961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:05.723806 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.734445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1180/2345] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:05.740121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.749921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131083-7714-4f20-99ca-04ac72d8315c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.755589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.756251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.756532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.756815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.757652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f916636d41e34b51a3411c5a1fece34a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.757768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:07:05.757956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.759623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:05.766019 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f916636d41e34b51a3411c5a1fece34a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.767131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f916636d41e34b51a3411c5a1fece34a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.773899 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1181/2346] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:07:05.779348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.781381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.781791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f916636d41e34b51a3411c5a1fece34a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.791498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4ed328d-d466-4199-b49b-985386e60b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f916636d41e34b51a3411c5a1fece34a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:05.798231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a7ad-2ac7-49c0-a4b2-746990b2fc90 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.799909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1166/2347] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:07:05 2022] DELETE /identity/v3/users/f916636d41e34b51a3411c5a1fece34a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:05.804878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.805169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.805446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.831363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:05.833227 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.866649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.867279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.867562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.867868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.868533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.870586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:05.882799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:05.900599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1182/2348] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:07:05 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:07:05.904706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.906563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1167/2349] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:05.917297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:05.918967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:05.984142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c72dc-3637-405b-a184-74f42238f5ce admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.990208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:05.990882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:05.991175 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:05.991451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:05.992262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:05.992770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e56b82-7267-47e1-afb7-35bf0cf4bd30 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:05.994336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.025154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1183/2350] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:07:05 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:07:06.026025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.038287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8df8a-789c-41ed-b46c-0b4b0171a7a1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.045228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.046510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.046510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.047134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.048328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.051917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.064891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1184/2351] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:07:06.067235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.068197 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.068563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.068859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.070008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.081559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.083458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b413-e876-4a4d-823e-e9db1ad0a0ff admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.084361 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.089242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:06.096873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.097732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.097888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.098211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.099292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.100897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51981592-2c12-4e57-854b-f12a19e102fa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.105478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1168/2352] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:07:06.118516 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1185/2353] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:07:06.122025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.153329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20cb2-7f1d-416c-b971-9c31c692b5e1 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.169869 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.170900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.171868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.172423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] PATH_INFO: `/v3/projects/ad9b23a6a10a49d6a323b335de6dd219/users/986aa4f797f7495297dc97b3eb198128/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.204937 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9b23a6a10a49d6a323b335de6dd219, user_id=986aa4f797f7495297dc97b3eb198128, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.208846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.241414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1169/2354] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:07:06 2022] PUT /identity/v3/projects/ad9b23a6a10a49d6a323b335de6dd219/users/986aa4f797f7495297dc97b3eb198128/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:07:06.253124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.253406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.254292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.303089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] MFA Rules not processed for user `986aa4f797f7495297dc97b3eb198128`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:06.304764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.401590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1186/2355] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:06.415813 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.423737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.432598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.434254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.516286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04384917-f493-49e3-a78a-181cfdf67314 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.523349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:06.526912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.527560 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.528036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.528331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.539996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.542886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.565590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1170/2356] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:06.574318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d4355-c8bb-4f36-9521-56b9943f3240 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.587729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.589014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.590744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.591873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] PATH_INFO: `/v3/projects/ced22cac760c43579905ea83f6b42ee3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.598006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.599117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced22cac760c43579905ea83f6b42ee3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.602438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.609578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a010-a7b8-4c70-a348-685a3a459779 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:06.616232 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:06.617156 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.617882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.618458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] PATH_INFO: `/v3/users/986aa4f797f7495297dc97b3eb198128` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.620081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986aa4f797f7495297dc97b3eb198128)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:06.622664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:06.706010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986aa4f797f7495297dc97b3eb198128'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.720046 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced22cac760c43579905ea83f6b42ee3', 'request_id': 'req-7275074e-405e-4a96-b4cf-7cda64c1d9d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.731935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986aa4f797f7495297dc97b3eb198128'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.732902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986aa4f797f7495297dc97b3eb198128'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.734101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced22cac760c43579905ea83f6b42ee3', 'request_id': 'req-7275074e-405e-4a96-b4cf-7cda64c1d9d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.747388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced22cac760c43579905ea83f6b42ee3', 'request_id': 'req-7275074e-405e-4a96-b4cf-7cda64c1d9d6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.761110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986aa4f797f7495297dc97b3eb198128'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.773070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] The token cache is being invalidate because project ced22cac760c43579905ea83f6b42ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:07:06.773357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.778390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7275074e-405e-4a96-b4cf-7cda64c1d9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.781436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1187/2357] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:07:06 2022] DELETE /identity/v3/projects/ced22cac760c43579905ea83f6b42ee3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:06.786425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.786732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.788405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.791274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4e1c5f0f-c204-45b8-a6df-df208fb70227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986aa4f797f7495297dc97b3eb198128'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:06.803022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1171/2358] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:07:06 2022] DELETE /identity/v3/users/986aa4f797f7495297dc97b3eb198128 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:07:06.808288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c923a-1db9-4975-9e28-c607c9130f1a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.809794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c923a-1db9-4975-9e28-c607c9130f1a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.810397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c923a-1db9-4975-9e28-c607c9130f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.842093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fb2c923a-1db9-4975-9e28-c607c9130f1a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:06.843745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fb2c923a-1db9-4975-9e28-c607c9130f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.854568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:06.855825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.920288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:06.958507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1172/2359] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:06.958507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:06.958507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:06.958507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:06.972142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1188/2360] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:06.973693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:06.977588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:06.985200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:06.986994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:07.000776 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1173/2361] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:07.002093 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.014765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d21a-8c66-47b8-975c-56f5542a9e53 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.022931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.023583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.023893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.024460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.025173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:07:07.025476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.027495 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.047474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1174/2362] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:07:07.048794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.066056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7cd6-21e4-4476-89dc-70985ab838da admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.069320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c427441-b1c3-4ce2-a3e2-de2a42e4439a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.073840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.074293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.074626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.074974 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.075193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.075391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.075821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.075948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.076625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.078684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.093893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.095363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.110587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1189/2363] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:07.144799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1175/2364] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:07:07 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:07:07.146309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.156876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936367-2071-4ff8-b304-d526e78e6eb1 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.189583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:07.270275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.271352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.271695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.272153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.273257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.276343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.329267 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1190/2365] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:07:07 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:07:07.329724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.344562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f300-a7f3-4e05-bbfe-d9db90982f5a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.351687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.352549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.352914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.353931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.354574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.356763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.373450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1176/2366] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:07:07.375413 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.391391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0120d95-ec2a-4435-b64f-3c8f5da19e83 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.397993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.398710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.399065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.399407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.400532 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.402122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70389d-3abb-451c-8e44-81c2a73cecad admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.414565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1191/2367] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:07:07.419318 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.436145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265254bf-4c79-4818-aa0c-00dc36105535 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.444334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.445159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.445436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.445712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] PATH_INFO: `/v3/projects/b0ab093edb944772ae7b6fd285178a43/users/6f89a5e4981e423b84d5f28b33bd9629/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.467811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ab093edb944772ae7b6fd285178a43, user_id=6f89a5e4981e423b84d5f28b33bd9629, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.471020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.488375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1177/2368] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:07:07 2022] PUT /identity/v3/projects/b0ab093edb944772ae7b6fd285178a43/users/6f89a5e4981e423b84d5f28b33bd9629/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:07.493633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.493919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.494194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.524320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:07.526356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:07.605404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1192/2369] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:07.615646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.705160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a271aa-1879-4295-a6dd-79cd27a64b4c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.713411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.714063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.714329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.714680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.733786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.735366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aaa41-b655-4d07-877a-fe3869deb0f0 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:07.748637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1178/2370] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:07.897425 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:07.899048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:07.921322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d29d-26f4-4e78-86f3-23285cc34c91 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:07.927383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:07.928394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:07.928512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:07.928863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] PATH_INFO: `/v3/projects/ad9b23a6a10a49d6a323b335de6dd219` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:07.930316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9b23a6a10a49d6a323b335de6dd219)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:07.932318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.059124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9b23a6a10a49d6a323b335de6dd219', 'request_id': 'req-b7cd1756-2209-4046-a51c-8df7c745480d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:08.084034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9b23a6a10a49d6a323b335de6dd219', 'request_id': 'req-b7cd1756-2209-4046-a51c-8df7c745480d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:08.105773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9b23a6a10a49d6a323b335de6dd219', 'request_id': 'req-b7cd1756-2209-4046-a51c-8df7c745480d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:08.150767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] The token cache is being invalidate because project ad9b23a6a10a49d6a323b335de6dd219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:07:08.150767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:08.151503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7cd1756-2209-4046-a51c-8df7c745480d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:07:08.163702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1193/2371] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:07:07 2022] DELETE /identity/v3/projects/ad9b23a6a10a49d6a323b335de6dd219 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:08.164225 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acef04-4b10-4ca2-b1a8-05d8dceee3f9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.165166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acef04-4b10-4ca2-b1a8-05d8dceee3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.165758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acef04-4b10-4ca2-b1a8-05d8dceee3f9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.168592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1179/2372] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:07:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:07:08.171886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.173366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.173964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.175671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2ac2-4b5c-47a4-bb06-d91606ff2d8f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.176020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2ac2-4b5c-47a4-bb06-d91606ff2d8f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.176316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2ac2-4b5c-47a4-bb06-d91606ff2d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.209822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b16e2ac2-4b5c-47a4-bb06-d91606ff2d8f None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.211315 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b16e2ac2-4b5c-47a4-bb06-d91606ff2d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.221323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.223221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.279567 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:08.348042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1180/2373] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:08.352222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1194/2374] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:08.360114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.360640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.361233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.368508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.369920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.393147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:08.405378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.406591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.435823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1181/2375] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:08.437954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.459140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573693-c336-402c-bd61-c4e2a0ddb203 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.469811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.470704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.470950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.471228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.471991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:07:08.472385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.476052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.483416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b31ef-3ee5-4591-ae38-7ac67f265a30 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.491065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.492645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.493146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.493595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.495822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1182/2376] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:07:08.498595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.507972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.509805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.526375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38fd2-134f-482b-84eb-8b48c60a6ad7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.534166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1195/2377] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:07:08.534748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.534748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.534748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.534996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.536343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.538970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4e351-b8a0-4e0e-9696-2170202bb85e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.598198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1183/2378] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:07:08.603566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.616142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e816-af95-4eea-85c1-5127ce1ac92e service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.618942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9099d-31ff-493d-9db6-cdd5040e1949 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.619223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9099d-31ff-493d-9db6-cdd5040e1949 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.619492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9099d-31ff-493d-9db6-cdd5040e1949 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.620883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1184/2379] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 20:07:08.625440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.625791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.626133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.653420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.655186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.687832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.688466 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.688752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.689271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.690064 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.693469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.718245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1196/2380] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:07:08.721683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1185/2381] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:08.723221 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.734582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.735085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b98d-4269-446b-b3c0-59b3d53a28f3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.736419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.741231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.741880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.742147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.742417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.743121 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.745024 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.752770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c748d6-d28f-4fdb-875e-3c0b509d87dd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.760465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1197/2382] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:07:08.760664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.760664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.760664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.760664 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.761573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.769575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.771018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.773087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11a62-7c76-427b-ab3a-acad64174868 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.779268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.780122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.780407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.780910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1186/2383] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:07:08.783953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.785472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.787172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b84fa-43df-4fa7-a3da-7a15a47f6e38 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.799530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1198/2384] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:07:08.804940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:08.818871 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0ec6e-1a65-408b-924c-1b3514c04bb3 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:08.824384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:08.825296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.825731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.826157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] PATH_INFO: `/v3/projects/62c8d8166fe14ab5a1651d0d48dff37a/users/3b2fcb1887f749dcb488c63054290a45/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.845825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c8d8166fe14ab5a1651d0d48dff37a, user_id=3b2fcb1887f749dcb488c63054290a45, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:08.848578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98dfe-6d32-4912-a7fc-91c354b2c57b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:08.866121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1187/2385] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:07:08 2022] PUT /identity/v3/projects/62c8d8166fe14ab5a1651d0d48dff37a/users/3b2fcb1887f749dcb488c63054290a45/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:07:08.873116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.873467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.873808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.896522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.897875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.911747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2963c2-ff77-41bd-bc27-abc50b5597c9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.912572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2963c2-ff77-41bd-bc27-abc50b5597c9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.913427 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2963c2-ff77-41bd-bc27-abc50b5597c9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.917161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1188/2386] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:07:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 20:07:08.932141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:08.932764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:08.933228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:08.942505 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:08.978270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:08.979527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:08.991063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1199/2387] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:09.002446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:09.100532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1189/2388] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:07:09.120455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eebcf-4d41-460a-9153-9dc74e69a072 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:09.125787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:09.126904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:09.127463 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:09.128317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:09.140536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:09.142446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac42f5-6e14-46ac-9270-aa98728fcf4d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:09.154862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1200/2389] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:09.236338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:09.240057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:09.262483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb16c-5ef5-488a-9645-7847507cc64a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:09.277274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:09.277923 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:09.278202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:09.278474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:09.306821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:09.308833 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:09.336722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1190/2390] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:11.161697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1ab1-8e3b-470f-b651-c772ae2b20aa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:11.162222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1ab1-8e3b-470f-b651-c772ae2b20aa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:11.162222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1ab1-8e3b-470f-b651-c772ae2b20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:11.225061 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7b5c1ab1-8e3b-470f-b651-c772ae2b20aa None None] MFA Rules not processed for user `3b2fcb1887f749dcb488c63054290a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:11.229382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7b5c1ab1-8e3b-470f-b651-c772ae2b20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:11.381183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1201/2391] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:11.393499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:11.396790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:11.442747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:11.590529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e6f2-2ea1-4a0e-b1c8-2f4d67d2de34 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:11.595166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:11.596408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:11.596408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:11.596830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:11.611633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:11.614683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082e37-ca24-4bf0-84ad-dc95437abe7f service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:11.641989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1191/2392] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:13.304112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:13.305645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:13.306529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:13.339378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] MFA Rules not processed for user `3b2fcb1887f749dcb488c63054290a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:13.340679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:13.350925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1202/2393] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:14.429554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40d8e-41f0-42db-9a56-816a5af174bb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:14.430146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40d8e-41f0-42db-9a56-816a5af174bb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:14.430392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40d8e-41f0-42db-9a56-816a5af174bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:14.497723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fec40d8e-41f0-42db-9a56-816a5af174bb None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:14.499389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fec40d8e-41f0-42db-9a56-816a5af174bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:14.628801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1192/2394] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:07:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:14.642160 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:14.644808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:14.844182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:14.849754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de0ea-dd29-459b-85c6-3a1c5fc6aef6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:14.858375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:14.859263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:14.859868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:14.860715 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:14.883668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:14.885766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:14.905092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1203/2395] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:15.264497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:15.265709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:15.266260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:15.356648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] MFA Rules not processed for user `6f89a5e4981e423b84d5f28b33bd9629`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:15.358768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:15.491015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:15.493072 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:15.500049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1193/2396] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:15.537510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c81e-8270-4096-ad58-607d4496c9df service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:15.555308 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:15.555984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:15.556253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:15.556724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:15.557565 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:15.559640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:15.620890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1204/2397] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:07:15 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:07:15.624667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:15.645491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280af6-5b90-4a8f-919e-f3f7c914ce61 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:15.817401 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:15.829696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:15.830351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:15.830633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:15.830906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:15.832400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:15.835005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:15.890938 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1194/2398] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:07:15 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:07:15.895300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:15.915982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19c548-e05b-40d5-a40b-b282c668e937 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:15.938379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:15.939045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:15.939329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:15.939604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:15.944351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:15.950261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:15.983614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1205/2399] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:07:15.984595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:15.996797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009bad3-eb02-476b-ac0a-59967eb23c34 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:16.001676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:16.004804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:16.004804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:16.004804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] PATH_INFO: `/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b/users/26df2e727a9644f1af972e84c24d4cf7/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:16.041596 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db911458ccf4e9b9af54c004d3d1b8b, user_id=26df2e727a9644f1af972e84c24d4cf7, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:16.048403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:16.096016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:16.096669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1195/2400] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:07:15 2022] PUT /identity/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b/users/26df2e727a9644f1af972e84c24d4cf7/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:16.114523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e400-e57d-46d2-b4c3-8bb8d2dee386 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:16.267222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:16.268534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:16.269895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:16.270497 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:16.272034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:16.274517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:16.317520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1206/2401] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:07:16.318035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:16.354637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a652301-a3dd-4d71-8902-4c5b7ca4f9a7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:16.364739 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:16.365922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:16.366207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:16.367004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] PATH_INFO: `/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b/users/26df2e727a9644f1af972e84c24d4cf7/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:16.370511 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db911458ccf4e9b9af54c004d3d1b8b, user_id=26df2e727a9644f1af972e84c24d4cf7, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:16.373589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0db8b8-8760-4ad1-bbd5-3172aa444f10 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:16.399721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1196/2402] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:07:16 2022] PUT /identity/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b/users/26df2e727a9644f1af972e84c24d4cf7/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:07:23.635725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:23.638164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:23.849701 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002950b7-8791-4398-85e5-41dff1fb812f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:23.967682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:24.007442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:24.012389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:24.012674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:24.012948 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:24.020657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:24.053080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:24.054900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:24.082472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1207/2403] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:26.385201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=20,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:26.629280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca852d3-be5f-4e23-bdf6-75047eb88909 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:26.629773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca852d3-be5f-4e23-bdf6-75047eb88909 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:26.630170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca852d3-be5f-4e23-bdf6-75047eb88909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:26.686082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0ca852d3-be5f-4e23-bdf6-75047eb88909 None None] MFA Rules not processed for user `26df2e727a9644f1af972e84c24d4cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:26.688349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0ca852d3-be5f-4e23-bdf6-75047eb88909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:26.819533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1197/2404] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:26.932182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:26.933587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:27.052967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b1d5-8608-493b-b6a3-ad267b5c5c5a service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:27.060294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:27.061343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:27.062106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:27.062106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:27.136687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:27.138388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:27.151922 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1208/2405] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:07:36.806640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=34 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:37.146455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=62 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:41.196287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745678-350f-4b3a-8fa7-3f038fedb0d9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:41.196816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745678-350f-4b3a-8fa7-3f038fedb0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:41.196816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745678-350f-4b3a-8fa7-3f038fedb0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:41.220697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5c745678-350f-4b3a-8fa7-3f038fedb0d9 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:41.222815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5c745678-350f-4b3a-8fa7-3f038fedb0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:41.289574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1198/2406] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:07:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:41.315927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:41.387088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ae271-7caf-4340-8268-6f3536b5f982 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:41.392019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:41.392603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:41.392882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:41.393153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:41.401868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:41.403494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a252-3186-46a1-bab2-f6d5e074e92e service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:41.411816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1209/2407] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:45.499873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:45.500914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:45.501347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:45.537150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] MFA Rules not processed for user `10705004cfd74f0caddef9db51f1a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:45.540584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:45.609716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1199/2408] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:50.928863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:50.929469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:50.929469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:50.949285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] MFA Rules not processed for user `6f89a5e4981e423b84d5f28b33bd9629`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:07:50.950474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:50.957319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1210/2409] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:07:52.047644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:07:52.122501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6c3a2-fb27-4ed9-ab06-0725cbc43c98 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:07:52.126110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:07:52.126729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:07:52.127006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:07:52.127274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:07:52.129252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:07:52.200453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:07:52.205293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fec6cb-9d81-41d0-9576-b3c99d4cda40 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:07:52.212459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:52.218540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1200/2410] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:07:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:08:00.942718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=35 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:13.518798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:08:13.529218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb80209-0da5-4772-b69b-6e5f2cf29d9e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:08:13.532770 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:08:13.533375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:08:13.533653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:08:13.533925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:08:13.544367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:08:13.545814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85802c9-1776-4be2-a491-8c4432314187 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:08:13.555185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1211/2411] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:08:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:08:23.551008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:52.863415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:08:52.863993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:08:52.863993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:08:52.883073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] MFA Rules not processed for user `3b2fcb1887f749dcb488c63054290a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:08:52.884289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:08:52.939616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1201/2412] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:08:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:09:02.932887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=25 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:04.153414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d99f8-da9d-4ad2-b141-2b4409706ac6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:04.154837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d99f8-da9d-4ad2-b141-2b4409706ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:04.158018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d99f8-da9d-4ad2-b141-2b4409706ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:04.186614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8e3d99f8-da9d-4ad2-b141-2b4409706ac6 None None] MFA Rules not processed for user `67e79817ed9e40728f92a22053a24118`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:09:04.188074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8e3d99f8-da9d-4ad2-b141-2b4409706ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:04.267747 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1212/2413] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:09:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:09:04.981146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:09:04.993337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a2d9-7581-4914-bb8f-e5012d378427 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:09:04.997062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:09:04.997683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:04.998013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:04.998299 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:05.001008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:05.015191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:09:05.016806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:09:05.028211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1202/2414] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:09:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:09:07.538234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e309-8650-497d-9062-e3711d825227 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:07.538745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e309-8650-497d-9062-e3711d825227 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:07.538846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e309-8650-497d-9062-e3711d825227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:07.563430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7063e309-8650-497d-9062-e3711d825227 None None] MFA Rules not processed for user `edf898f67aca42db8d51924ca4d8a300`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:09:07.564780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7063e309-8650-497d-9062-e3711d825227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:07.640514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1213/2415] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:09:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:09:07.692489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:09:07.760913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86539a94-5ec9-48c5-848c-cb998bf8fa4a service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:09:07.765654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:09:07.765654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:07.766071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:07.766071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:07.767822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:07.782666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:09:07.784959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:09:07.800135 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1203/2416] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:09:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:09:17.631541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=50 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:17.794480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=32 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:17.890771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e309-8650-497d-9062-e3711d825227 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:09:17.892191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7063e309-8650-497d-9062-e3711d825227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:17.908334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e309-8650-497d-9062-e3711d825227 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:09:17.913790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:09:17.914404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:17.914680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:17.914949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:17.916896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:17.930838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:09:17.932517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:09:17.941822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1214/2417] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:09:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:09:27.937354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:39.812411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:09:39.822392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfbb8-5ccb-477f-a093-f86ba56798db service glance] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:09:39.827153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:09:39.827761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:39.828189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:39.828460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:39.830334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:39.840166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:09:39.841643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:09:39.850716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1204/2418] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:09:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:09:44.204136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:09:44.215211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1870fc-26a3-4faa-8bad-22af9c37cb0b service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:09:44.221542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:09:44.222154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:09:44.222453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:09:44.222693 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:09:44.224473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:09:44.239960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:09:44.241579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:09:44.252411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1215/2419] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:09:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:09:49.847024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:54.248284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:07.439284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:07.453406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe02d07-29dd-4f40-b738-46dfb754b698 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:07.459298 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:07.460005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:07.460286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:07.460572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:07.462292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:07.474045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:07.475615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:07.485527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1205/2420] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:09.752966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:09.764990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc72f-7a65-427d-903e-c32d882b5688 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:09.769976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:09.770672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:09.771012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:09.771345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:09.773166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:09.785346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:09.786912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:09.798038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1216/2421] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:09.822935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:09.897921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e0f3-775e-4c2c-80a5-badcceea3d40 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:09.903173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:09.904303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:09.904903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:09.905038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] PATH_INFO: `/v3/users/3b2fcb1887f749dcb488c63054290a45` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:09.906297 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2fcb1887f749dcb488c63054290a45)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:09.908507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:09.967927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2fcb1887f749dcb488c63054290a45'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:09.975357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2fcb1887f749dcb488c63054290a45'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:09.976074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2fcb1887f749dcb488c63054290a45'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:09.988921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2fcb1887f749dcb488c63054290a45'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:09.997275 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0549734f-2b72-4b93-936c-ce42b88f189a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2fcb1887f749dcb488c63054290a45'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.003504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1206/2422] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:10:09 2022] DELETE /identity/v3/users/3b2fcb1887f749dcb488c63054290a45 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:10:10.197815 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.216188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9428d3-1d37-4134-bfdc-5d247621f913 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.307051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.307697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.308001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.308268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] PATH_INFO: `/v3/projects/62c8d8166fe14ab5a1651d0d48dff37a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.309700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c8d8166fe14ab5a1651d0d48dff37a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.311625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.357410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c8d8166fe14ab5a1651d0d48dff37a', 'request_id': 'req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.363395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c8d8166fe14ab5a1651d0d48dff37a', 'request_id': 'req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.368752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c8d8166fe14ab5a1651d0d48dff37a', 'request_id': 'req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.381512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] The token cache is being invalidate because project 62c8d8166fe14ab5a1651d0d48dff37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:10:10.381798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.382417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ab0fc23-2a44-4b04-a05e-46bc3c7c053e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:10:10.383956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1217/2423] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:10:10 2022] DELETE /identity/v3/projects/62c8d8166fe14ab5a1651d0d48dff37a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:10:10.388965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.389311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.389615 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.409918 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:10.411362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:10.477304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1207/2424] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:10.486006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.486289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.486560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.507345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:10.508573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:10.516640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1218/2425] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:10.521245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.533707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f945c-9e89-4369-881d-690ec38e60e7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.541053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.542006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.542456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.542893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.544532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:10:10.544829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.546423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.547956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:10.562579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1208/2426] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:10:10.563579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.572888 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768fcf-6cba-4132-9677-ac8400fc1b6b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.578029 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.578637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.578915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.579185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.579887 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.581786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.610451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1219/2427] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:10:10 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:10:10.614578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.626881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa8a6-2dcb-45f1-a555-a7ac486804cf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.687114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.687726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.688035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.688310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.689072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.690984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.712442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1209/2428] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:10:10 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:10:10.717501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.728607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9a42-5161-4f7a-9e22-0dc49f290bb1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.737011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.737745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.738025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.738296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.739014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.740653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.753097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1220/2429] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:10:10.757078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.769513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0bd2-00ec-410f-ae23-c7f45490d005 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.774259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.774874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.775154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.775430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.776166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.777800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a9702-486f-4fb0-ab7d-3e193aea93e9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.789435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1210/2430] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:10:10.795143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.805454 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda06ac-57eb-41f1-8dd0-962740ba820b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:10.810277 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:10.810957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.811364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.811638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] PATH_INFO: `/v3/projects/c8dacae2d58843f2b1b8b532759b83ee/users/44c083ae1c5a4444a55ecb26cfdd58ca/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.828273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dacae2d58843f2b1b8b532759b83ee, user_id=44c083ae1c5a4444a55ecb26cfdd58ca, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:10.830904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:10.845562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1221/2431] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:10:10 2022] PUT /identity/v3/projects/c8dacae2d58843f2b1b8b532759b83ee/users/44c083ae1c5a4444a55ecb26cfdd58ca/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:10:10.850251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9c86-1e1a-44fd-8ff2-777a039fa6cb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:10.850704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9c86-1e1a-44fd-8ff2-777a039fa6cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:10.850808 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9c86-1e1a-44fd-8ff2-777a039fa6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:10.869373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-916e9c86-1e1a-44fd-8ff2-777a039fa6cb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:10.870577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-916e9c86-1e1a-44fd-8ff2-777a039fa6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:10.936999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1211/2432] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:10.953658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:10.955490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:10.970373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:11.015321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9916d-2b8e-458c-937b-2c8a6e69fa18 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:11.018873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:11.019488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:11.019765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:11.020065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:11.029107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:11.030513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:11.040211 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1222/2433] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:15.656287 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:15.656955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:15.656955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:15.706904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] MFA Rules not processed for user `44c083ae1c5a4444a55ecb26cfdd58ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:15.706904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:15.782040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1212/2434] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:15.782965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:15.794166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761df2ed-7cdc-4acf-938f-36742bd73552 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:15.799276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:15.799934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:15.800215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:15.800489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:15.801146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:15.803036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:15.833981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1223/2435] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:10:15 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:10:15.839270 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:15.845899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:15.854064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da282-55f5-4d6c-8fb6-a31e92e523b3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:15.920773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:15.921465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:15.921812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:15.922153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:15.922900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:15.924944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:15.950106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1213/2436] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:10:15 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:10:15.953816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:15.965015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560bbad-4c10-495c-84a0-1c8faf724f73 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:15.970977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989287bc-091b-40fb-9968-140056a867be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:15.971896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989287bc-091b-40fb-9968-140056a867be admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:15.972391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989287bc-091b-40fb-9968-140056a867be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:15.972905 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989287bc-091b-40fb-9968-140056a867be admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:15.973620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989287bc-091b-40fb-9968-140056a867be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:15.975245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989287bc-091b-40fb-9968-140056a867be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:15.992215 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1224/2437] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:10:15.999848 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:16.004188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:16.004471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:16.004742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:16.005954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771def75-2531-4b56-ba3e-9463489d2403 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:16.012036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:16.012823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:16.013177 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:16.013523 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] PATH_INFO: `/v3/projects/ecf9c8aac1ab457187a1398aab348da8/users/d711ce824a0c472796515517621de589/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:16.034044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9c8aac1ab457187a1398aab348da8, user_id=d711ce824a0c472796515517621de589, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:16.037607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:16.040910 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] MFA Rules not processed for user `10705004cfd74f0caddef9db51f1a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:16.042159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:16.059465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1214/2438] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:10:15 2022] PUT /identity/v3/projects/ecf9c8aac1ab457187a1398aab348da8/users/d711ce824a0c472796515517621de589/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:10:16.065989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:16.116282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1225/2439] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:10:16.161693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb594b2-7e67-4520-b1df-35ee53c9afd7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:16.169138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:16.169772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:16.170055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:16.170328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:16.171145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:16.173125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac17a3-b657-4534-8b4b-dc0b301d5735 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:16.184419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1215/2440] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:10:16.188750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:16.201091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39389-a368-45ec-819a-157b7d843036 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:16.208949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:16.209645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:16.209924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:16.210199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] PATH_INFO: `/v3/projects/ecf9c8aac1ab457187a1398aab348da8/users/d711ce824a0c472796515517621de589/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:16.212640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9c8aac1ab457187a1398aab348da8, user_id=d711ce824a0c472796515517621de589, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:16.216418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:16.238090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1226/2441] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:10:16 2022] PUT /identity/v3/projects/ecf9c8aac1ab457187a1398aab348da8/users/d711ce824a0c472796515517621de589/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:10:22.070258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69578-dc27-457e-8664-7e72abbc3cbb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:22.070820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69578-dc27-457e-8664-7e72abbc3cbb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:22.070820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69578-dc27-457e-8664-7e72abbc3cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:22.114441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-64f69578-dc27-457e-8664-7e72abbc3cbb None None] MFA Rules not processed for user `d711ce824a0c472796515517621de589`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:22.115697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-64f69578-dc27-457e-8664-7e72abbc3cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:22.183183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:22.210624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1216/2442] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:22.220712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:22.222839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:22.294232 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744f6d7-ca64-4b18-9c04-5ea447fc1590 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:22.298074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e8c4b63db4457aab286cf3f228dd26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:22.298710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:22.299213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:22.299489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:22.332884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:22.370117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:22.373301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:22.389843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1227/2443] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:22.522466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ecc3-4d41-4548-bbb2-0212c20f6405 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:22.522875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ecc3-4d41-4548-bbb2-0212c20f6405 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:22.523294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ecc3-4d41-4548-bbb2-0212c20f6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:22.555578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0b51ecc3-4d41-4548-bbb2-0212c20f6405 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:22.556875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0b51ecc3-4d41-4548-bbb2-0212c20f6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:22.652078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1217/2444] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:10:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:22.751336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:22.752991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:22.854481 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bfe4c-c7a6-4f32-ac7e-c7375d9e220b service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:22.860916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:22.861708 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:22.861993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:22.862263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:22.872494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:22.874654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:22.892138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1228/2445] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:10:26.723205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:26.723205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:26.723205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:26.777675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:26.781449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:26.799332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1218/2446] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:10:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:10:26.822172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:26.849801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6979-f39e-49f5-be47-5e390242869d service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:26.882964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:26.884320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:26.884759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:26.886432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:26.907042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:26.909156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193336f3-a0a7-4a78-a556-52ea4df1c849 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:26.924164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1229/2447] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:10:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 20:10:27.066836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:27.070840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:27.279731 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82a954-4c11-464e-82fd-44985ea927a5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:27.298770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:27.299442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:27.299719 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:27.300018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:27.301946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:27.336235 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:27.337860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3f1f2-8c92-42b0-9c41-5b12d9ac1b87 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:27.376324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1219/2448] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:31.786318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:31.787321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:31.787847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:31.840550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] MFA Rules not processed for user `67e79817ed9e40728f92a22053a24118`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:31.843741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:31.954441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1230/2449] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:35.520698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:35.521735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:35.522109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:35.556491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] MFA Rules not processed for user `44c083ae1c5a4444a55ecb26cfdd58ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:35.560344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:35.581976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1220/2450] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:35.847171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:35.848813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:35.890414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:35.942112 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731acb60-4746-4fec-8672-2d5dfd8a2622 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:35.949129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:35.950478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:35.950918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:35.951356 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:35.954831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:35.965363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:35.972581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:35.975375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:35.976967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548797e-6744-4eea-ab81-17dbd0ea8047 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:35.986716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:35.987356 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:35.987635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:35.987931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:35.990461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:35.994404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1231/2451] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:10:36.003229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:36.004710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7d25-c3e8-4d9d-b6c2-72a48c0cd4a6 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:36.014573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1221/2452] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:10:36.370236 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:36.371691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:36.491617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e63c-e749-4d8c-8575-208a9060c616 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:36.498966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:36.500053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:36.500343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:36.500797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:36.503586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:36.517932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:36.520016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:36.557093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1232/2453] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:38.793045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ad64-d430-482a-a533-d712ff209bc3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:38.793563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ad64-d430-482a-a533-d712ff209bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:38.793804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ad64-d430-482a-a533-d712ff209bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:38.815679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f864ad64-d430-482a-a533-d712ff209bc3 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:38.817030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f864ad64-d430-482a-a533-d712ff209bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:38.824931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1222/2454] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:10:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:38.836792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:38.848611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1a13-f394-43ff-83f9-f4f7f3e9e8b2 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:38.853609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:38.854407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:38.854778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:38.855118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:38.864889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:38.866475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7dc07-c70e-45cc-9b44-4bad1d5fc224 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:38.875757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1233/2455] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 20:10:48.810108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:48.872851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=41 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:57.860779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6553-1cbd-4c2e-9380-695d7763d4d7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:57.861305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6553-1cbd-4c2e-9380-695d7763d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:57.861414 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6553-1cbd-4c2e-9380-695d7763d4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:57.881862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2dad6553-1cbd-4c2e-9380-695d7763d4d7 None None] MFA Rules not processed for user `6f89a5e4981e423b84d5f28b33bd9629`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:57.883124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2dad6553-1cbd-4c2e-9380-695d7763d4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:57.945105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1223/2456] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:58.434554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2b35-f91f-4620-8959-d913bb0975be None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.435131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2b35-f91f-4620-8959-d913bb0975be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.435131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2b35-f91f-4620-8959-d913bb0975be None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.436563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1234/2457] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:10:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:10:58.444707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe085-9ef6-404a-8cc2-ab7ea57d0076 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.444992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe085-9ef6-404a-8cc2-ab7ea57d0076 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.445262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe085-9ef6-404a-8cc2-ab7ea57d0076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.484396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f3abe085-9ef6-404a-8cc2-ab7ea57d0076 None None] MFA Rules not processed for user `732dac2174a84e28be298417ecc2370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:58.485798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f3abe085-9ef6-404a-8cc2-ab7ea57d0076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:58.497658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1224/2458] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:10:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:58.510843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2b35-f91f-4620-8959-d913bb0975be None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:58.522395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2b35-f91f-4620-8959-d913bb0975be None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:58.526787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:58.527397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.527676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.527966 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.536957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:58.538971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d702-dca8-4ecb-8ad7-6e7e1b68bb9a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:58.547637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1235/2459] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:10:58.651906 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0f4a-5b6d-4efa-8754-247b14a8d66c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.652276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0f4a-5b6d-4efa-8754-247b14a8d66c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.652880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0f4a-5b6d-4efa-8754-247b14a8d66c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.654458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1225/2460] 10.222.0.95 () {54 vars in 921 bytes} [Fri Aug 5 20:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 20:10:58.659959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.660252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.660529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.685581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] MFA Rules not processed for user `b7f6f07c961a46329912067a520beae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:10:58.686927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:10:58.699408 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1236/2461] 10.222.0.95 () {58 vars in 1018 bytes} [Fri Aug 5 20:10:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:10:58.712520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d0f4a-5b6d-4efa-8754-247b14a8d66c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:10:58.725077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d0f4a-5b6d-4efa-8754-247b14a8d66c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:10:58.730929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:10:58.731885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:10:58.732474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:10:58.732821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:10:58.747273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:10:58.748343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bdca8-da48-4da8-9097-080c750dd309 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:10:58.761990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1226/2462] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:10:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:00.404914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:00.406021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:00.473756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf697-087b-4dae-9a01-dfede9b50df4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:00.477274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:00.477893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:00.478173 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:00.478963 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:00.480914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:00.540291 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:00.542542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:00.551710 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1237/2463] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:00.929314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:00.929903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:00.929903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:00.952964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:00.954435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:00.977014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1227/2464] 10.222.0.95 () {58 vars in 1009 bytes} [Fri Aug 5 20:11:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:00.992167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:01.006894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2477d1-25c9-43c4-a8f5-a97b7371c2aa service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:01.013660 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:01.014687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:01.015507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:01.016032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:01.027829 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:01.032852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5f9c1-7b64-49d8-afcd-fbe07e83bc8a service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:01.061282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1238/2465] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:03.999921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:04.013070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86239d2-d220-49cc-bc5d-f7e7e6e96cb8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:04.018802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:04.019420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:04.019694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:04.020010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:04.021759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:04.034674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:04.036685 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:04.051257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1228/2466] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:11.039836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=63 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:14.044805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=43 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:22.280170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:22.280632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:22.280756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:22.300603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:22.301704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:22.309563 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1239/2467] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:11:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:22.332504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:22.343718 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fa9e-adb5-479b-827b-16235e3d682d service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:22.348708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:22.349307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:22.349582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:22.349849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:22.359290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:22.360951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:22.370289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1229/2468] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:25.363261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:25.372792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4947e2-48b2-492b-8910-6a470b75f1d7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:25.376359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:25.376962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:25.377234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:25.377502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:25.387437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:25.388877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:25.399923 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1240/2469] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:32.366569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:35.394270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=9 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:39.532927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:39.543215 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735a8f7-ce8e-4d95-ab59-ca1d7b46e277 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:39.546778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:39.547378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:39.547655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:39.547965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:39.549702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:39.611629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:39.613074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:39.622583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1230/2470] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:42.785711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:42.814906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7db9b-dcad-4453-94b1-eb41bd6925f8 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:42.821184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:42.822661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:42.822661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:42.822900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:42.824911 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:42.838222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:42.839883 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:42.860080 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1241/2471] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:42.877645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:42.879221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:42.893431 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a98f-f66d-419d-a0f5-386e9aa6ff15 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:42.898576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:42.899273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:42.900185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:42.900650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] PATH_INFO: `/v3/users/10705004cfd74f0caddef9db51f1a52c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:42.902810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10705004cfd74f0caddef9db51f1a52c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:42.905085 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:42.970526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10705004cfd74f0caddef9db51f1a52c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:42.976006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10705004cfd74f0caddef9db51f1a52c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:42.977023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10705004cfd74f0caddef9db51f1a52c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:42.991486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10705004cfd74f0caddef9db51f1a52c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:42.999689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-be352153-886b-49e8-b061-1b98d28a9f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10705004cfd74f0caddef9db51f1a52c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.005849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1231/2472] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:11:42 2022] DELETE /identity/v3/users/10705004cfd74f0caddef9db51f1a52c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:11:43.177649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.189328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556f27e-32da-4e00-b613-0a109a357842 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.249282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.249921 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.250197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.250469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] PATH_INFO: `/v3/projects/573a75f13f7240479c725daba27011bf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.252025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=573a75f13f7240479c725daba27011bf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.253900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.305739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573a75f13f7240479c725daba27011bf', 'request_id': 'req-472d243d-6c90-414e-87d6-27038bb11a1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.312035 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573a75f13f7240479c725daba27011bf', 'request_id': 'req-472d243d-6c90-414e-87d6-27038bb11a1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.317664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573a75f13f7240479c725daba27011bf', 'request_id': 'req-472d243d-6c90-414e-87d6-27038bb11a1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.329451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] The token cache is being invalidate because project 573a75f13f7240479c725daba27011bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:11:43.329832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.330496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-472d243d-6c90-414e-87d6-27038bb11a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:11:43.332077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1242/2473] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:11:43 2022] DELETE /identity/v3/projects/573a75f13f7240479c725daba27011bf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:11:43.337526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.337809 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.338084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.357873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:43.359057 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:43.421460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1232/2474] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:43.430867 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.431099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.431372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.451191 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:43.452422 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:43.460641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1243/2475] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:43.465916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.475627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9af029-9c2e-4955-bb0c-8866b903dbc8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.480957 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.481561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.481841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.482108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.482799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:11:43.483096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.484711 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.486173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:43.498548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1233/2476] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:11:43.502947 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.512543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6badb39-ae88-48f0-ba61-14693fd5e641 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.517242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.517845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.518119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.518385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.519079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.520979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.550744 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1244/2477] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:11:43 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:11:43.554922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.564997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910fcb-1445-48b0-b7da-86f441fafdbf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.622175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.622800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.623079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.623377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.624107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.626459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.649066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1234/2478] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:11:43 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:11:43.653877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.664302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab52ff-d386-4ea8-ab3b-2715da255229 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.669018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.669619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.669898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.670166 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.670875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.672496 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.682367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1245/2479] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:11:43.686288 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.696952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ed6d1-76d3-43cb-bfca-35dbb02df6ea admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.701766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.702411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.702692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.702967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.703683 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.705448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b5b0-bc38-4890-b5f4-139e8a0c9c65 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.717913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1235/2480] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:11:43.722228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.732355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961c1be-69e4-4422-8a63-59364bc7cba6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.736959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.737606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.737885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.738156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] PATH_INFO: `/v3/projects/d3f34fc2ca3d4b32be53a5658100a336/users/1aff2581168d4498ad3823ed3e4ff3f9/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.752984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f34fc2ca3d4b32be53a5658100a336, user_id=1aff2581168d4498ad3823ed3e4ff3f9, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.755606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.768973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1246/2481] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:11:43 2022] PUT /identity/v3/projects/d3f34fc2ca3d4b32be53a5658100a336/users/1aff2581168d4498ad3823ed3e4ff3f9/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:11:43.774082 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89d63-64f2-4c37-bc7f-e903881ff4ad None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.774405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89d63-64f2-4c37-bc7f-e903881ff4ad None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.775469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89d63-64f2-4c37-bc7f-e903881ff4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.794991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-56c89d63-64f2-4c37-bc7f-e903881ff4ad None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:43.796219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-56c89d63-64f2-4c37-bc7f-e903881ff4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:43.855284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1236/2482] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:43.864848 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:43.866632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:43.880704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:43.925940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638495d-9c8c-43bb-a9d0-ed553004f559 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:43.929602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:43.930213 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:43.930494 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:43.931171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:43.941571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:43.943392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:43.954724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1247/2483] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:48.204767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878e4d-00dc-4f28-8dec-6a9496e6259c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:48.205309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878e4d-00dc-4f28-8dec-6a9496e6259c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:48.205309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878e4d-00dc-4f28-8dec-6a9496e6259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:48.254536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e4878e4d-00dc-4f28-8dec-6a9496e6259c None None] MFA Rules not processed for user `1aff2581168d4498ad3823ed3e4ff3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:48.255761 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e4878e4d-00dc-4f28-8dec-6a9496e6259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:48.329465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1237/2484] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:11:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:48.344231 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:11:48.345824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:48.429338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e41fe-0614-42b4-be32-830773968bba service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:11:48.436958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:11:48.437622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:48.437902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:48.438174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:48.447205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:11:48.448832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:11:48.458792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1248/2485] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:11:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:11:49.839494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:11:49.839989 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:11:49.840092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:11:49.848122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:49.863418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] MFA Rules not processed for user `1aff2581168d4498ad3823ed3e4ff3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:11:49.864845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:11:49.872036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1238/2486] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:11:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:11:58.454099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=54 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:59.858570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:11.412464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:11.433685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906117-a4b0-4ab9-a0f4-7b57eead7641 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:11.437774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:11.438386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:11.438663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:11.438931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:11.440750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:11.504628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:11.506077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:11.524871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1249/2487] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:15.225902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:15.227697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:15.282437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1de01-0a8a-4d45-91a2-b36f5cb28482 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:15.287553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:15.288432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:15.288726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:15.289011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] PATH_INFO: `/v3/users/67e79817ed9e40728f92a22053a24118` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:15.290210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e79817ed9e40728f92a22053a24118)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:15.292780 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:15.341130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e79817ed9e40728f92a22053a24118'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.348067 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e79817ed9e40728f92a22053a24118'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.348675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e79817ed9e40728f92a22053a24118'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.362678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e79817ed9e40728f92a22053a24118'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.369793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3259c53f-2747-4f23-a752-048ac51078f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e79817ed9e40728f92a22053a24118'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.376973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1239/2488] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:15 2022] DELETE /identity/v3/users/67e79817ed9e40728f92a22053a24118 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:15.604683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:15.619120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912194-2953-4d0d-8101-ea0e62cc4640 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:15.735472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:15.736433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:15.736895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:15.737344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] PATH_INFO: `/v3/projects/43323ff64b8843639e0428c69d5c71c1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:15.738582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43323ff64b8843639e0428c69d5c71c1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:15.740528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:15.799384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43323ff64b8843639e0428c69d5c71c1', 'request_id': 'req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.806186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43323ff64b8843639e0428c69d5c71c1', 'request_id': 'req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.812529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43323ff64b8843639e0428c69d5c71c1', 'request_id': 'req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.827087 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] The token cache is being invalidate because project 43323ff64b8843639e0428c69d5c71c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:15.827358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.828007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4f24e4f7-bb96-4f33-8c3f-6f93bde2c445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:15.829521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1250/2489] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:15 2022] DELETE /identity/v3/projects/43323ff64b8843639e0428c69d5c71c1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:15.834549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:15.834930 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:15.835273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:15.908940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:15.910150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:15.970412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1240/2490] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:12:15.978364 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:15.978645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:15.978917 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:15.999881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:16.001100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:16.009464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1251/2491] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:16.013827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.023829 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd928-8865-4a43-8d18-4f8a6dc951c0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.028898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.029533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.029811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.030084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.030793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:16.031095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.032753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.046377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1241/2492] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:12:16.050838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.055406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:16.062924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369dcad-e3bd-4fb9-bd98-163844bb3fdb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.069056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.069771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.070050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.070319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.071023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.073016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.104302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1252/2493] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:16 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:16.108540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.114104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:16.128358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932e6dc-5a89-4f15-8a1a-459a03e4d265 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.205709 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.206363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.206641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.206928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.208091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.209648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.236229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1242/2494] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:16 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:16.240857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.252847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c62e3-53a1-45f9-9e73-af5bb93e3531 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.263718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.265102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.265473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.265821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.267060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.269771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.282828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1253/2495] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:16.286935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.298231 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4788c-8825-49e9-b7f1-fd173e6352bc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.303020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.303703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.304022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.304300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.305000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.316375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e233-5130-4479-b5d2-cd320b71f60d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.339836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1243/2496] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:16.341343 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.352878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62488b-49de-45bb-8566-1a880a01a2b9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.359031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.359724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.360042 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.360324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] PATH_INFO: `/v3/projects/69bfada536f145b2aff8e7438875be8d/users/814f42aa882b408da10b2c4c779997be/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.379808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bfada536f145b2aff8e7438875be8d, user_id=814f42aa882b408da10b2c4c779997be, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.382692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.399214 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1254/2497] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:16 2022] PUT /identity/v3/projects/69bfada536f145b2aff8e7438875be8d/users/814f42aa882b408da10b2c4c779997be/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:16.410131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.410773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.411169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.457083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] MFA Rules not processed for user `814f42aa882b408da10b2c4c779997be`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:16.458423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:16.525104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1244/2498] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:12:16.529729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.603441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7bb7-488f-4a38-82cd-32a5a906cf60 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.609127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.609755 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.610034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.610305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.610976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.612914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.650353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1255/2499] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:16 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:16.654764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.666340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeae9b-ba5c-43e5-8be8-3bb1deab7633 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.737454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.738083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.738426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.739096 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.739373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.741486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.766565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:16.772624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1245/2500] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:16 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:16.776471 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.791346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea76af-ae05-4b7d-8e07-0c6473e0a738 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.797637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.798268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.798573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.798841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.799536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.801172 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.816302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1256/2501] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:16.817444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.828564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3018d-5d3c-4e83-8cf3-8979770626b5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.833432 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.834101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.834379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.834646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] PATH_INFO: `/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef/users/c3e89832466644e3aff7ad30c35d49f4/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.850920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d14dbb3eb4dfabde7644fddd7c2ef, user_id=c3e89832466644e3aff7ad30c35d49f4, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.853671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.868667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1246/2502] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:16 2022] PUT /identity/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef/users/c3e89832466644e3aff7ad30c35d49f4/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:16.873301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.883452 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c616a-fb54-4ec4-a800-dcf56236cc96 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.959371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.960023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.960372 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.960543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.961233 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:16.962803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665424f9-b022-4f7e-a8b3-d354ad48ef42 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:16.975837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1257/2503] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:16.978313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:16.989614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af25d-73f0-427e-8023-06b005ce922c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:16.994268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:16.994926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:16.995228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:16.995503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] PATH_INFO: `/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef/users/c3e89832466644e3aff7ad30c35d49f4/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:16.997499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d14dbb3eb4dfabde7644fddd7c2ef, user_id=c3e89832466644e3aff7ad30c35d49f4, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:17.000118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:17.010653 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1247/2504] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:16 2022] PUT /identity/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef/users/c3e89832466644e3aff7ad30c35d49f4/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:17.021904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:17.022190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:17.022467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:17.052316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] MFA Rules not processed for user `c3e89832466644e3aff7ad30c35d49f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:17.053550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:17.057612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:17.124604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1258/2505] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:17.135406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:17.137420 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:17.207379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f5b7-dd4f-484f-a0f3-df337d5c64b8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:17.211267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:17.211947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:17.212230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:17.212502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:17.222454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:17.224036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35868a65-b226-45d0-924d-24a18bb667b1 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:17.235875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1248/2506] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:17 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:17.415528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:17.508355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff6c62-cf8f-44bf-b853-025e57c2c06f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:17.514238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:17.514898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:17.515174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:17.515442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] PATH_INFO: `/v3/users/814f42aa882b408da10b2c4c779997be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:17.516646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=814f42aa882b408da10b2c4c779997be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:17.518889 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:17.575645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814f42aa882b408da10b2c4c779997be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:17.576332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814f42aa882b408da10b2c4c779997be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:17.588531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814f42aa882b408da10b2c4c779997be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:17.596872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814f42aa882b408da10b2c4c779997be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:17.604409 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814f42aa882b408da10b2c4c779997be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:17.610845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1259/2507] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:17 2022] DELETE /identity/v3/users/814f42aa882b408da10b2c4c779997be => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:17.615374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:17.615834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:17.615961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:17.635129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:17.636471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:17.701786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1249/2508] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:17.711579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:17.713410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:17.736601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:17.773298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f859-c8bc-4b03-bcc8-f977980db7db admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:17.777663 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:17.778371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:17.778666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:17.778935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:17.788977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:17.790480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:17.801595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1260/2509] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:18.084441 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:18.085879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:18.098752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b2d0b-e620-4294-a448-d25384f17ca5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:18.103800 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:18.104466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.104466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.105189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] PATH_INFO: `/v3/projects/69bfada536f145b2aff8e7438875be8d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.106247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bfada536f145b2aff8e7438875be8d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:18.108186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:18.156449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bfada536f145b2aff8e7438875be8d', 'request_id': 'req-ff6a3b23-15dc-4072-baaa-62699f79ffb5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.158946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:18.165046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bfada536f145b2aff8e7438875be8d', 'request_id': 'req-ff6a3b23-15dc-4072-baaa-62699f79ffb5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.171799 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bfada536f145b2aff8e7438875be8d', 'request_id': 'req-ff6a3b23-15dc-4072-baaa-62699f79ffb5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.182576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] The token cache is being invalidate because project 69bfada536f145b2aff8e7438875be8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:18.183192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.183975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.185494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1250/2510] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:18 2022] DELETE /identity/v3/projects/69bfada536f145b2aff8e7438875be8d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:18.189504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:18.200395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac73b-bcdb-4209-8276-d1d56b2d4ac1 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:18.256826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:18.257377 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.257651 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.257936 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] PATH_INFO: `/v3/users/c3e89832466644e3aff7ad30c35d49f4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.259054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e89832466644e3aff7ad30c35d49f4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:18.261506 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:18.306012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e89832466644e3aff7ad30c35d49f4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.306642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e89832466644e3aff7ad30c35d49f4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.319082 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e89832466644e3aff7ad30c35d49f4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.326312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e89832466644e3aff7ad30c35d49f4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.334432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6f780d0-c669-4b61-8266-60e3f54ab05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e89832466644e3aff7ad30c35d49f4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.340381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1261/2511] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:18 2022] DELETE /identity/v3/users/c3e89832466644e3aff7ad30c35d49f4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:18.617283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:18.618987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:18.636099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a3b23-15dc-4072-baaa-62699f79ffb5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:18.723885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:18.724533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.724804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.725070 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] PATH_INFO: `/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.726387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3d14dbb3eb4dfabde7644fddd7c2ef)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:18.728333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:18.783377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3d14dbb3eb4dfabde7644fddd7c2ef', 'request_id': 'req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.794267 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3d14dbb3eb4dfabde7644fddd7c2ef', 'request_id': 'req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.800996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3d14dbb3eb4dfabde7644fddd7c2ef', 'request_id': 'req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.814803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] The token cache is being invalidate because project ee3d14dbb3eb4dfabde7644fddd7c2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:18.815222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.816204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4edb978a-8e0a-4ef0-9856-2b9f6f81b548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:18.821210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1251/2512] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:18 2022] DELETE /identity/v3/projects/ee3d14dbb3eb4dfabde7644fddd7c2ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:18.829342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.829854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.830162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.850140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:18.851325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:18.889055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:18.911924 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1262/2513] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:18.920335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.920621 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.920892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.940955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:18.942170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:18.950373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1252/2514] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:18.954595 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:18.964628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018dedb-2912-4f55-9fda-665b713f08d7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:18.969187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:18.969792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:18.970067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:18.970337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:18.971031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:18.971332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:18.972994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:18.985148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1263/2515] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:18.989208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:18.999260 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bdb62-6048-440f-b12d-f8032d389bc6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.003944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.004554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.004954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.005221 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.005892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.007753 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.035445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1253/2516] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:18 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:19.039554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.050803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8ae78-9e12-4af8-a90c-315db321fa6e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.111528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.112188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.112462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.112733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.113397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.115296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.138151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1264/2517] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:19.142332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.153777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8423-ea21-434f-8ef5-1b703e6f671d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.158426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.159036 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.159316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.159587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.160576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.162146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.173352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1254/2518] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:19.177502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.187549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541dcf-ad2c-47ea-8276-e321456b1b73 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.192189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.192795 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.193074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.193346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.194034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.195612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828db6c9-632f-4b86-827e-0310c19093ce admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.206169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1265/2519] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:19.210445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.220863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4819-571d-4efb-89ed-eb0cd06ac7e0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.225302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.225946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.226220 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.226489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] PATH_INFO: `/v3/projects/092290b5591146c5bf94e2187bf88e14/users/948625ff33d44a28bd68f0b065cccd5e/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.243818 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] RBAC: Authorizing `identity:create_grant(project_id=092290b5591146c5bf94e2187bf88e14, user_id=948625ff33d44a28bd68f0b065cccd5e, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.246893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.259604 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1255/2520] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:19 2022] PUT /identity/v3/projects/092290b5591146c5bf94e2187bf88e14/users/948625ff33d44a28bd68f0b065cccd5e/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:19.270032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.270317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.270593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.300539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] MFA Rules not processed for user `948625ff33d44a28bd68f0b065cccd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:19.301809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:19.367623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1266/2521] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:19.372229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.381257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:19.438827 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470e0e-9cda-44ef-8930-c07b1e10314f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.443411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.444051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.444332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.444606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.445259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.447146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.473845 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1256/2522] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:19.478188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.490521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d140-01d2-4322-a9c9-846990700695 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.522352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:19.547075 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.547687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.547990 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.548260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.548907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.550821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.571751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1267/2523] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:19.576527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.586791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9e9e-f0d6-41ae-9ad7-e2b6a6291f95 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.592127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.592732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.593011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.593284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.593967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.595546 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.605934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1257/2524] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:19.609946 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.620591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c131e9-3e2a-4ac0-b721-f8d88bf5abbc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.625242 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.625843 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.626118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.626390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.627071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.628669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149d6ad-0202-4c2a-bb0b-081c94f9036d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.639186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1268/2525] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:19.643390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.654084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f6ba7-3321-4a29-a8f3-83625b8302bd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.658700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.659379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.659656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.660037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] PATH_INFO: `/v3/projects/274f7ddb544a486b93bce5b917870fa1/users/8559aeb1f12b4e2784056b923297d189/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.675032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=274f7ddb544a486b93bce5b917870fa1, user_id=8559aeb1f12b4e2784056b923297d189, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.677680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.690588 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1258/2526] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:19 2022] PUT /identity/v3/projects/274f7ddb544a486b93bce5b917870fa1/users/8559aeb1f12b4e2784056b923297d189/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:19.702615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.702967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.703240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.731568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] MFA Rules not processed for user `8559aeb1f12b4e2784056b923297d189`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:19.732801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:19.795872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1269/2527] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:19.800516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.864935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1d78-4ea9-4d60-b07c-af2ac649f35f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.869768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:19.871300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:19.871586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:19.872211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:19.872886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:19.874977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:19.915051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1259/2528] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:19.916049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.928718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40806c-0a88-4ca1-a3ba-f7b294f705fa None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:19.959349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:19.961562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:20.010124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.011594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.012126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.012585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.013270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.016198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.021241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:20.037599 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d412-69e6-4097-ac38-5073b98cba5b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.047510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1270/2529] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:19 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:20.051441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.058996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.060046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.060321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.060722 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.063704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:20.070430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e057f-c179-4108-a32f-8af6159b34e2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.076509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.077247 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.077623 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.077992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.078876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.079633 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.080581 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.081279 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.091599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1271/2530] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:12:20.091857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1260/2531] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:12:20.095593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.105824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78ee-1e3b-4515-a701-5222f0e1b938 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.110566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.111259 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.111538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.111870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] PATH_INFO: `/v3/projects/71be5adb5ef9405babd777333479660e/users/9e42fc2785aa40809aaa9a030417b00e/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.128601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be5adb5ef9405babd777333479660e, user_id=9e42fc2785aa40809aaa9a030417b00e, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.131226 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.141018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:20.145817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1272/2532] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:20 2022] PUT /identity/v3/projects/71be5adb5ef9405babd777333479660e/users/9e42fc2785aa40809aaa9a030417b00e/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:20.150759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.160925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f577b-36ca-4a0c-8c84-3658eb32044f service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.221788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.222405 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.222678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.222943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.223628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.225237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5cf53-7a21-4024-aa15-3ab0bf9745d1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.236398 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1261/2533] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:20.240672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.251171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fd64-ce0e-4b2e-be42-4615d8aa710b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.256059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.256731 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.257050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.257442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] PATH_INFO: `/v3/projects/71be5adb5ef9405babd777333479660e/users/9e42fc2785aa40809aaa9a030417b00e/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.259730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be5adb5ef9405babd777333479660e, user_id=9e42fc2785aa40809aaa9a030417b00e, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.263406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.274273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1273/2534] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:20 2022] PUT /identity/v3/projects/71be5adb5ef9405babd777333479660e/users/9e42fc2785aa40809aaa9a030417b00e/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:20.285468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.285750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.286023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.314077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] MFA Rules not processed for user `9e42fc2785aa40809aaa9a030417b00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:20.315305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:20.393583 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1262/2535] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:20.405750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.407470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:20.469845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece776-9f28-41af-a2eb-781d03d67d1d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.473507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.474126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.474403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.474674 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.484522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.485943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.495886 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1274/2536] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:20.540669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:20.542360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:20.554969 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294e287-8e57-42b9-8300-7f8a284dcaeb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:20.558795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:20.559490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:20.559872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:20.560212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:20.631849 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:20.633313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:20.643838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1263/2537] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:23.563558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:23.565009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:23.636234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:23.637283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929810-e64f-4b89-b08c-820934ad3694 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:23.641985 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:23.642730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:23.643107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:23.643284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:23.643587 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] PATH_INFO: `/v3/users/edf898f67aca42db8d51924ca4d8a300` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:23.644885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf898f67aca42db8d51924ca4d8a300)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:23.647090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:23.648276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64641-6116-47fd-a91b-c9c8c1468d8d service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:23.654416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:23.654592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:23.654831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:23.655128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] PATH_INFO: `/v3/users/948625ff33d44a28bd68f0b065cccd5e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:23.656464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=948625ff33d44a28bd68f0b065cccd5e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:23.658453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:23.696666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf898f67aca42db8d51924ca4d8a300'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.697284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf898f67aca42db8d51924ca4d8a300'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.711033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf898f67aca42db8d51924ca4d8a300'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.711593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948625ff33d44a28bd68f0b065cccd5e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.718792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf898f67aca42db8d51924ca4d8a300'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.719486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948625ff33d44a28bd68f0b065cccd5e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.720312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948625ff33d44a28bd68f0b065cccd5e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.727403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-32d98e88-97ab-4615-9564-50d96cd0b3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf898f67aca42db8d51924ca4d8a300'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.734702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948625ff33d44a28bd68f0b065cccd5e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.734856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1275/2538] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:23 2022] DELETE /identity/v3/users/edf898f67aca42db8d51924ca4d8a300 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:23.743878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948625ff33d44a28bd68f0b065cccd5e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:23.750801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1264/2539] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:23 2022] DELETE /identity/v3/users/948625ff33d44a28bd68f0b065cccd5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:23.755525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:23.756045 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:23.756330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:23.775896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:23.778136 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:23.782328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:23.846705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1276/2540] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:23.857139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:23.858532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:23.921389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:23.923110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:23.925706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac3f7-091e-4771-8ef6-fb41bac64f2e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:23.930874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:23.931637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:23.932015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:23.933038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:23.937309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6305f-6567-40c4-96ef-4b91498cb683 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:23.942816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:23.943631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:23.944023 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:23.944296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] PATH_INFO: `/v3/projects/0520f87324854dd0a5d0c9e10caa7fda` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:23.944828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:23.945635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0520f87324854dd0a5d0c9e10caa7fda)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:23.946585 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a56dc8-def9-4db9-94ae-91acc918d327 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:23.947570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:23.957271 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1265/2541] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:24.002521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0520f87324854dd0a5d0c9e10caa7fda', 'request_id': 'req-1d56bd12-e17f-41b3-9784-1d863058cb1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.009464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0520f87324854dd0a5d0c9e10caa7fda', 'request_id': 'req-1d56bd12-e17f-41b3-9784-1d863058cb1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.017040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0520f87324854dd0a5d0c9e10caa7fda', 'request_id': 'req-1d56bd12-e17f-41b3-9784-1d863058cb1d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.032098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] The token cache is being invalidate because project 0520f87324854dd0a5d0c9e10caa7fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:24.032418 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.033059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1d56bd12-e17f-41b3-9784-1d863058cb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.034927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1277/2542] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:23 2022] DELETE /identity/v3/projects/0520f87324854dd0a5d0c9e10caa7fda => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:24.040040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.040323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.040595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.061637 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:24.062961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.130913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1266/2543] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:24.139456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.139738 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.140114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.160646 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:24.162142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.170274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1278/2544] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:24.174557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.184533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd0934-2f84-4c62-9c1c-dbec7ff93940 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.189300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.190002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.190347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.190684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.191485 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:24.191881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.193461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.206493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1267/2545] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:24.211147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.221561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c12e4-57b0-4c7d-a21f-2aa006fdb2dc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.226412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.227119 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.227469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.227837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.228514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.231118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.252211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.254307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.262722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1279/2546] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:24.266764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.274797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad409b-585a-4165-8279-474df137b882 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.281095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:24.337067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1ac3-08e7-4009-b61e-f3393eb39d64 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.340041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.340678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.340953 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.341282 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] PATH_INFO: `/v3/projects/092290b5591146c5bf94e2187bf88e14` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.342362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=092290b5591146c5bf94e2187bf88e14)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.342937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.343619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.343999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.344314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.344432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.345142 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.347100 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.357025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:24.370994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1280/2547] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:24.375395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.385419 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee267a8-c1b0-4fb2-8694-c828898c2e44 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.395505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092290b5591146c5bf94e2187bf88e14', 'request_id': 'req-6c63c8d5-389c-492a-a50b-070e85df91eb'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.403300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092290b5591146c5bf94e2187bf88e14', 'request_id': 'req-6c63c8d5-389c-492a-a50b-070e85df91eb'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.409211 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092290b5591146c5bf94e2187bf88e14', 'request_id': 'req-6c63c8d5-389c-492a-a50b-070e85df91eb'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.428182 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] The token cache is being invalidate because project 092290b5591146c5bf94e2187bf88e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:24.428883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.429162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.430655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1268/2548] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:24 2022] DELETE /identity/v3/projects/092290b5591146c5bf94e2187bf88e14 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:24.435335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.437043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.455285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.455959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.456358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.456639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.457338 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.458943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.469758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1281/2549] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:12:24.473677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.475444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.488483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846b4a-4498-4652-93ab-5faa8632dd03 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.493361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.494088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.494462 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.495427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.496340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.498052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.503986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63c8d5-389c-492a-a50b-070e85df91eb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.508939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.509613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.509898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.510127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1282/2550] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:12:24.510250 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] PATH_INFO: `/v3/users/8559aeb1f12b4e2784056b923297d189` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.512411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8559aeb1f12b4e2784056b923297d189)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.514390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.514849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.524861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceb4b-d0c4-40a2-a5ea-93747874047b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.529624 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.530273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.530545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.530818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] PATH_INFO: `/v3/projects/018bb3888b2d44b791fda70328220868/users/6fe8ec9c81fc4a0fb1fe3149bc7c3cf3/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.546518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018bb3888b2d44b791fda70328220868, user_id=6fe8ec9c81fc4a0fb1fe3149bc7c3cf3, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.549281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3123d0-0e02-4586-889c-92152e4828c2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.559234 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:24.562837 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1283/2551] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:24 2022] PUT /identity/v3/projects/018bb3888b2d44b791fda70328220868/users/6fe8ec9c81fc4a0fb1fe3149bc7c3cf3/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:24.567060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8559aeb1f12b4e2784056b923297d189'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.574193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.574741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.574896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.577000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8559aeb1f12b4e2784056b923297d189'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.577783 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8559aeb1f12b4e2784056b923297d189'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.591189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8559aeb1f12b4e2784056b923297d189'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.600199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8559aeb1f12b4e2784056b923297d189'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:24.602255 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] MFA Rules not processed for user `6fe8ec9c81fc4a0fb1fe3149bc7c3cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:24.603440 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.606778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1269/2552] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:24 2022] DELETE /identity/v3/users/8559aeb1f12b4e2784056b923297d189 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:24.691811 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1284/2553] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:12:24.696125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.698112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.903532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182381c-b56b-4b50-a9e1-6e7c29ae8fe3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:24.908649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:24.909483 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:24.909786 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:24.910295 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:24.911166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:24.913304 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:24.917895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.919412 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:24.945971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1270/2554] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:24.950407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:24.972757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:24.992344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978547fc-576e-4d31-bdf4-38662f1974ca None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.015797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94159f0-e30b-4f81-b5fc-d59098cbf196 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.022064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.022772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.023044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.023307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.024006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.025904 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.053743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1271/2555] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:24 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:25.054915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.064476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754da8-fe90-43b5-a4cd-45c83d84df14 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.065316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.065960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.066235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.066502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] PATH_INFO: `/v3/projects/274f7ddb544a486b93bce5b917870fa1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.067650 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274f7ddb544a486b93bce5b917870fa1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.069408 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.069732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.070004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.070254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.070368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.070939 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.072543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.083531 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1272/2556] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:25.087603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.098061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ddec4-9a7c-408c-a89f-6825a8223c5f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.103450 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.104276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.104543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.104807 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] PATH_INFO: `/v3/projects/77994657c55a4247ab97becf664df713/users/610e91e9f0704bba9bcf9fe659f8dc77/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.121792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77994657c55a4247ab97becf664df713, user_id=610e91e9f0704bba9bcf9fe659f8dc77, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.123303 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274f7ddb544a486b93bce5b917870fa1', 'request_id': 'req-d7420009-74e8-4c94-8a65-eae8090e8e33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.124680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.127589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:25.129832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274f7ddb544a486b93bce5b917870fa1', 'request_id': 'req-d7420009-74e8-4c94-8a65-eae8090e8e33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.135916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274f7ddb544a486b93bce5b917870fa1', 'request_id': 'req-d7420009-74e8-4c94-8a65-eae8090e8e33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.140796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1273/2557] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:25 2022] PUT /identity/v3/projects/77994657c55a4247ab97becf664df713/users/610e91e9f0704bba9bcf9fe659f8dc77/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:25.144668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.148488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] The token cache is being invalidate because project 274f7ddb544a486b93bce5b917870fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:25.149063 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.149696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.152528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1285/2558] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:24 2022] DELETE /identity/v3/projects/274f7ddb544a486b93bce5b917870fa1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:25.156415 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.157741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.208340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe2ba-faff-4ad7-a943-3faa0a03d15d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.214324 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.215011 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.215291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.215586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.216335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.218045 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.223108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420009-74e8-4c94-8a65-eae8090e8e33 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.227759 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.228329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1274/2559] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:12:25.228473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.228723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.229048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] PATH_INFO: `/v3/users/9e42fc2785aa40809aaa9a030417b00e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.230931 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e42fc2785aa40809aaa9a030417b00e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.233056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.233220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.235442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.248885 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb338e-a358-4d30-8a6f-f7ca6594469f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.253580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.254237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.254515 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.254789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] PATH_INFO: `/v3/projects/77994657c55a4247ab97becf664df713/users/610e91e9f0704bba9bcf9fe659f8dc77/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.256637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:25.256853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77994657c55a4247ab97becf664df713, user_id=610e91e9f0704bba9bcf9fe659f8dc77, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.259988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7d1ab-764a-46ac-b033-9b26650daef5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.271584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1275/2560] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:25 2022] PUT /identity/v3/projects/77994657c55a4247ab97becf664df713/users/610e91e9f0704bba9bcf9fe659f8dc77/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:25.284269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.284671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.285276 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.287543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e42fc2785aa40809aaa9a030417b00e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.288235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e42fc2785aa40809aaa9a030417b00e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.300964 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e42fc2785aa40809aaa9a030417b00e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.308630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e42fc2785aa40809aaa9a030417b00e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.314173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] MFA Rules not processed for user `610e91e9f0704bba9bcf9fe659f8dc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:25.315520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.316578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e42fc2785aa40809aaa9a030417b00e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.323032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1286/2561] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:25 2022] DELETE /identity/v3/users/9e42fc2785aa40809aaa9a030417b00e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:25.386673 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1276/2562] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:12:25.397918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.399475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.460048 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b0ab-76ff-43c3-8c1c-c1fdf0e5c0ba admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.464333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.464972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.465238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.465503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.534411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.536861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.549340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1287/2563] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:25.632854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.633445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:25.634368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.646165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94d41-47d8-4ecd-865f-89179353a00e service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.650955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.652204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.652629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.653341 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.654776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.705474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ed87-81d3-4f1b-a708-04ef69a3ffe8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:25.706442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:25.713314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:25.721609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.723047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeaf00-1d91-43f7-93e5-aa6b337911a0 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.733862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1288/2564] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:25.764316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:25.765110 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.765332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.765469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] PATH_INFO: `/v3/projects/71be5adb5ef9405babd777333479660e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.766622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71be5adb5ef9405babd777333479660e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:25.768532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:25.819233 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71be5adb5ef9405babd777333479660e', 'request_id': 'req-45a63472-1fa7-4fe1-b86e-16e64a0afd06'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.828394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71be5adb5ef9405babd777333479660e', 'request_id': 'req-45a63472-1fa7-4fe1-b86e-16e64a0afd06'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.848925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71be5adb5ef9405babd777333479660e', 'request_id': 'req-45a63472-1fa7-4fe1-b86e-16e64a0afd06'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.862332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] The token cache is being invalidate because project 71be5adb5ef9405babd777333479660e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:25.862713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.863506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-45a63472-1fa7-4fe1-b86e-16e64a0afd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:25.866174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1277/2565] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:25 2022] DELETE /identity/v3/projects/71be5adb5ef9405babd777333479660e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:25.877672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.877672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.877672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.894727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:25.895897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.955592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1289/2566] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:12:25.964830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:25.965108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:25.965379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:25.985453 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:25.986647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:25.994458 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1278/2567] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:25.999249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.009333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16293c-f319-43fd-a258-cdb3f554819d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.014399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.015016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.015294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.015562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.016333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:26.016635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.018227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.030664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1290/2568] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:26.035563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.045513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6995bc4-9680-4b95-97e9-7f91ba5b227f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.050187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.050784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.051066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.051326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.052013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.053867 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.080990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1279/2569] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:26 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:26.085186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.096240 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146ebe4-a741-4062-bad8-931d096a43c7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.152810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.153340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.153616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.153882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.154530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.156524 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.177989 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1291/2570] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:26 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:26.182241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.192687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25b4b-2657-4463-8f1a-fe4ae7037b2f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.197454 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.198072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.198320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.198586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.199269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.200883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.210887 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1280/2571] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:26.215531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.225554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f748a1-33ab-4bb1-8546-9d77ff0afaac admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.230845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.231528 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.231700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.232004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.232785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.234257 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d994de-3679-494c-9453-13e1faafbe20 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.245639 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1292/2572] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:12:26.249899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.259577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e886-63cb-4d33-8d72-6c6f2bb71699 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.265205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.265844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.266113 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.266376 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] PATH_INFO: `/v3/projects/d10800ec422f48c883180e29bae9b377/users/0b643d4ba7ff42f4bba0d21d6880906e/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.281525 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10800ec422f48c883180e29bae9b377, user_id=0b643d4ba7ff42f4bba0d21d6880906e, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.284193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.297995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1281/2573] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:26 2022] PUT /identity/v3/projects/d10800ec422f48c883180e29bae9b377/users/0b643d4ba7ff42f4bba0d21d6880906e/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:26.311151 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.311432 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.311704 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.338204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] MFA Rules not processed for user `0b643d4ba7ff42f4bba0d21d6880906e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:26.339459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:26.382033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:26.404559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1293/2574] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:26.415895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.418139 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:26.466533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:26.483721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868dc20-00b4-4455-9609-93aaafba15eb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.487522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.488162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.488481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.488821 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.497794 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.499186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f462e-1156-4a8c-b53f-4d54e2efb9a4 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.507608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1282/2575] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:26.530178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.594488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d83e91-2e3e-4686-96c8-9f2fb38db52f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.599205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.599872 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.600222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.600478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] PATH_INFO: `/v3/users/0b643d4ba7ff42f4bba0d21d6880906e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.601678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b643d4ba7ff42f4bba0d21d6880906e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.603551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.654962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b643d4ba7ff42f4bba0d21d6880906e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:26.655592 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b643d4ba7ff42f4bba0d21d6880906e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:26.668821 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b643d4ba7ff42f4bba0d21d6880906e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:26.675533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b643d4ba7ff42f4bba0d21d6880906e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:26.681951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b643d4ba7ff42f4bba0d21d6880906e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:26.688256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1294/2576] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:26 2022] DELETE /identity/v3/users/0b643d4ba7ff42f4bba0d21d6880906e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:26.692726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.693185 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.693465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.712716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:26.714618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:26.773047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1283/2577] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:26.783686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:26.785355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:26.855685 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:26.865038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d47b-42fc-4aef-80fa-f4f8e4d1e344 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:26.869253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:26.870775 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:26.871053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:26.871322 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:26.880743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:26.882324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07708da2-81cc-4f19-b353-42d211960f29 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:26.893137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1295/2578] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:27.178386 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.179847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:27.200291 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65171cbe-ac05-43fb-928e-1f65ba412339 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.205608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.206479 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.206757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.207166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] PATH_INFO: `/v3/projects/d10800ec422f48c883180e29bae9b377` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.208462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10800ec422f48c883180e29bae9b377)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.210677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.271316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10800ec422f48c883180e29bae9b377', 'request_id': 'req-930099df-bf3b-4f39-b407-6713d7ec1a0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:27.280852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10800ec422f48c883180e29bae9b377', 'request_id': 'req-930099df-bf3b-4f39-b407-6713d7ec1a0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:27.290335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10800ec422f48c883180e29bae9b377', 'request_id': 'req-930099df-bf3b-4f39-b407-6713d7ec1a0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:27.303663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] The token cache is being invalidate because project d10800ec422f48c883180e29bae9b377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:27.304039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:27.304747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-930099df-bf3b-4f39-b407-6713d7ec1a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:27.306306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1284/2579] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:27 2022] DELETE /identity/v3/projects/d10800ec422f48c883180e29bae9b377 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:27.312096 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.312381 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.312671 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.331908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:27.333088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:27.394345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1296/2580] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:27.403025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.403303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.403591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.423814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:27.425010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:27.433191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1285/2581] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:27.437430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.447208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe73ff-602b-4e86-9f65-2a5e8a872125 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.452519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.453129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.453407 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.453677 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.454368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:27.454669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.456273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.468695 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1297/2582] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:27.472936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.482966 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697dd4-01cd-48d1-8b0e-e7f4d74e3e37 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.487710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.488347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.488622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.488888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.489549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.491486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.518674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1286/2583] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:27 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:27.522879 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.532812 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e4c5-69e1-4cf8-9792-f80c50610f09 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.589501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.590111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.590385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.590653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.591314 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.593305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.613844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1298/2584] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:27 2022] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:27.618037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.629468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c6202-d48c-4411-8cf3-3614617615d7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.634007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.634612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.634889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.635157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.636567 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.638162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.647995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1287/2585] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:27.652287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.662950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7052ec-dc20-466a-9db6-b7ac8342f823 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.669015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.669635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.669912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.670182 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.670870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.672514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff1808-b0b2-4296-a5e7-4a3038c634b7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.685965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1299/2586] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:27.690002 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:27.700804 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054ff-243b-4014-a54b-fb3fa123d6fa admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:27.705412 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:27.706056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.706331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.706600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] PATH_INFO: `/v3/projects/32d70965ade44e279df5c75dbd8bb336/users/e3b2291f3dc848ad95daa552566e2ae3/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.721063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d70965ade44e279df5c75dbd8bb336, user_id=e3b2291f3dc848ad95daa552566e2ae3, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:27.723725 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:27.734335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:27.740306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1288/2587] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:27 2022] PUT /identity/v3/projects/32d70965ade44e279df5c75dbd8bb336/users/e3b2291f3dc848ad95daa552566e2ae3/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:27.752569 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:27.752854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:27.753131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:27.906500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] MFA Rules not processed for user `e3b2291f3dc848ad95daa552566e2ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:27.907729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:27.948745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:27.971955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1300/2588] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:28.006763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:28.008470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.073996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c040c2f-6ad6-4387-850d-a2ec7ac0eb12 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:28.077540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:28.078144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.078419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.078687 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.087105 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:28.088559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e3845-5cb1-475b-af39-83952f956018 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:28.097174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1289/2589] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:28.113059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:28.175105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffd1c-7f2b-4367-bdf7-eb096ed65d86 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:28.179703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:28.180363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.180640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.180915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] PATH_INFO: `/v3/users/e3b2291f3dc848ad95daa552566e2ae3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.182187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b2291f3dc848ad95daa552566e2ae3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:28.184503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:28.231571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b2291f3dc848ad95daa552566e2ae3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.232304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b2291f3dc848ad95daa552566e2ae3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.244584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b2291f3dc848ad95daa552566e2ae3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.251207 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b2291f3dc848ad95daa552566e2ae3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.259653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b2291f3dc848ad95daa552566e2ae3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.265635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1301/2590] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:28 2022] DELETE /identity/v3/users/e3b2291f3dc848ad95daa552566e2ae3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:28.270099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.270517 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.270791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.290659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:28.292666 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.351142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1290/2591] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:28.361729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:28.363445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.429824 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143808fb-a722-4310-8e64-f93f8fb753b8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:28.435254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:28.435891 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.436159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.437549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.450162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:28.451714 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172a0af-c690-44df-822e-024bede96143 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:28.462083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1302/2592] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:28.760043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:28.762638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.778029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f498d6a-ecfd-4150-a59b-4ebd7611290e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:28.784332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:28.785407 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.785710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.785934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] PATH_INFO: `/v3/projects/32d70965ade44e279df5c75dbd8bb336` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.788253 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d70965ade44e279df5c75dbd8bb336)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:28.791424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:28.837564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d70965ade44e279df5c75dbd8bb336', 'request_id': 'req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.844948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d70965ade44e279df5c75dbd8bb336', 'request_id': 'req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.850387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d70965ade44e279df5c75dbd8bb336', 'request_id': 'req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.861359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] The token cache is being invalidate because project 32d70965ade44e279df5c75dbd8bb336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:28.861640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.862263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97fbcde2-9dcf-46bf-b8d7-557e92fb53e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:28.863802 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1291/2593] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:28 2022] DELETE /identity/v3/projects/32d70965ade44e279df5c75dbd8bb336 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:12:28.868631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.869108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.869218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.878467 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:28.890351 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:28.891596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.948800 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1303/2594] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:28.956537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:28.956824 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:28.957098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:28.976909 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:28.978100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:28.985902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1292/2595] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:28.990088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.000280 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236833-b278-4d61-8788-1fbaa4134b59 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.004934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.005526 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.005832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.006098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.006782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:29.007079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.008737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.021031 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1304/2596] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:29.025054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.034090 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa001-a11b-48c4-814d-67759e0c6e5c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.039069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.039674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.039975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.040243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.040898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.042853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.064005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:29.075095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1293/2597] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:29.077028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.091508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bfb8-7d39-4ecc-b981-d7381e5a1136 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.157515 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.158123 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.158398 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.158668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.159324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.161492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.181268 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1305/2598] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:29.186038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.196072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bee27-8d66-4215-8dad-883b7b87239d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.201259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.201854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.202129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.202397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.203084 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.204669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.214498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1294/2599] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:29.218416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.228295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a781ab-8dce-402c-b8e7-a6a09d7c40eb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.233668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.234274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.234559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.234830 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.235549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.237108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf931c-6293-4030-8d08-417f48c5a005 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.247983 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1306/2600] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:29.252163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.262477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2e03c-b865-41b9-8df3-1cb690acbb81 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.267212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.267892 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.268166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.268435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] PATH_INFO: `/v3/projects/9e2a95b453a74155bac916728ec69e5a/users/1d3cee4b60614215be79302dcd990b6a/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.283497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2a95b453a74155bac916728ec69e5a, user_id=1d3cee4b60614215be79302dcd990b6a, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.286373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.299708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1295/2601] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:29 2022] PUT /identity/v3/projects/9e2a95b453a74155bac916728ec69e5a/users/1d3cee4b60614215be79302dcd990b6a/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:29.311698 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.312009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.312306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.340411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] MFA Rules not processed for user `1d3cee4b60614215be79302dcd990b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:29.341609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:29.402805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:29.406858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1307/2602] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:29.411759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.485749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d138-729d-481e-b8f6-c4087e0ae35c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.491042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.491657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.491982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.492350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.493029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.495302 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.522703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1296/2603] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:29.527402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.538321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15531df-8daf-4538-ac1f-171a1bdb29e1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.594013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.594625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.594904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.595174 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.595850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.597722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.618118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1308/2604] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:29.622573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.633043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2491612-8b88-4556-b0cd-7260df194b54 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.638623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.639269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.639543 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.639840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.640538 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.642101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.653358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1297/2605] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:29.657590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.668459 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799e2f-92fe-4cdb-ae37-f480fabd157c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.673099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.673750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.674026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.674297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] PATH_INFO: `/v3/projects/07fa0dfb850545649ffedbac007d8d52/users/79d142d8f4104f7d8fe8658139c799c2/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.690091 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fa0dfb850545649ffedbac007d8d52, user_id=79d142d8f4104f7d8fe8658139c799c2, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.692727 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.706224 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1309/2606] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:29 2022] PUT /identity/v3/projects/07fa0dfb850545649ffedbac007d8d52/users/79d142d8f4104f7d8fe8658139c799c2/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:29.710190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.720402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de4b0-ffe0-4b45-acdd-6673cafe9445 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.776366 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.777357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.777357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.777357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.778059 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.779650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf7a2-8d81-4249-a549-fcb4d62a863e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.790464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1298/2607] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:29.795036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.805382 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced36682-28ce-41ae-96a2-84354fb5e4bb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:29.810551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:29.811199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.811469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.811733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] PATH_INFO: `/v3/projects/07fa0dfb850545649ffedbac007d8d52/users/79d142d8f4104f7d8fe8658139c799c2/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.813665 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fa0dfb850545649ffedbac007d8d52, user_id=79d142d8f4104f7d8fe8658139c799c2, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:29.816295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:29.826868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1310/2608] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:29 2022] PUT /identity/v3/projects/07fa0dfb850545649ffedbac007d8d52/users/79d142d8f4104f7d8fe8658139c799c2/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:29.837702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:29.838005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:29.838377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:29.865209 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] MFA Rules not processed for user `79d142d8f4104f7d8fe8658139c799c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:29.866393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:29.887383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:29.935474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1299/2609] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:29.946375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:29.948202 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:30.004417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f62fa-fba1-4e84-ba53-7100dfde24a9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:30.008012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:30.008616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:30.008909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:30.009158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:30.066590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:30.067962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7833b85-104c-4a98-a493-8d9714ad8fb3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:30.077498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1311/2610] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:33.667146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:33.729688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67776-cd0d-4bc1-a1b9-c1bc3e1d3343 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:33.734703 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:33.735790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:33.735790 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:33.736034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] PATH_INFO: `/v3/users/1d3cee4b60614215be79302dcd990b6a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:33.737419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3cee4b60614215be79302dcd990b6a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:33.739595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:33.786924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3cee4b60614215be79302dcd990b6a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:33.793677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3cee4b60614215be79302dcd990b6a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:33.794478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3cee4b60614215be79302dcd990b6a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:33.806121 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3cee4b60614215be79302dcd990b6a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:33.813742 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3cee4b60614215be79302dcd990b6a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:33.819559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1300/2611] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:33 2022] DELETE /identity/v3/users/1d3cee4b60614215be79302dcd990b6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:33.824238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:33.825301 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:33.825445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:33.838349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:33.845253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:33.846857 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:33.905726 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1312/2612] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:33.916111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:33.917489 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:33.959735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:33.976707 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59a3a-4e11-44a3-97ae-5c0c59a7cd0c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:33.980418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:33.981004 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:33.981285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:33.981557 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:33.990729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:33.992199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:34.002159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1301/2613] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:34.272260 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:34.273722 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:34.287741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366003-84ce-4a73-af38-cf166621f83c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:34.292311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:34.292956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:34.294253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:34.294253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] PATH_INFO: `/v3/projects/9e2a95b453a74155bac916728ec69e5a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:34.295491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2a95b453a74155bac916728ec69e5a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:34.297501 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:34.344290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2a95b453a74155bac916728ec69e5a', 'request_id': 'req-59203ef1-cd4b-440f-8ecb-2aa186401128'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.350299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2a95b453a74155bac916728ec69e5a', 'request_id': 'req-59203ef1-cd4b-440f-8ecb-2aa186401128'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.355880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2a95b453a74155bac916728ec69e5a', 'request_id': 'req-59203ef1-cd4b-440f-8ecb-2aa186401128'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.369114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] The token cache is being invalidate because project 9e2a95b453a74155bac916728ec69e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:34.369447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.370065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.371620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1313/2614] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:34 2022] DELETE /identity/v3/projects/9e2a95b453a74155bac916728ec69e5a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:34.375568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:34.385805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4cc3-1dd2-41dc-82fe-9e5f9dfef536 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:34.451768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:34.452468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:34.452746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:34.453015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] PATH_INFO: `/v3/users/79d142d8f4104f7d8fe8658139c799c2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:34.454173 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d142d8f4104f7d8fe8658139c799c2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:34.456076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:34.506773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d142d8f4104f7d8fe8658139c799c2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.514186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d142d8f4104f7d8fe8658139c799c2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.514864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d142d8f4104f7d8fe8658139c799c2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.526732 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d142d8f4104f7d8fe8658139c799c2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.534870 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0264d037-fd4b-44dc-8935-65d8b154f186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d142d8f4104f7d8fe8658139c799c2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.540868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1302/2615] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:34 2022] DELETE /identity/v3/users/79d142d8f4104f7d8fe8658139c799c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:34.825325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:34.826913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:34.844718 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59203ef1-cd4b-440f-8ecb-2aa186401128 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:34.903088 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:34.904625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:34.904904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:34.905176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] PATH_INFO: `/v3/projects/07fa0dfb850545649ffedbac007d8d52` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:34.906333 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fa0dfb850545649ffedbac007d8d52)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:34.908279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:34.943427 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:34.957991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fa0dfb850545649ffedbac007d8d52', 'request_id': 'req-a888879e-628f-427d-98b2-bf30399b7b55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.965273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fa0dfb850545649ffedbac007d8d52', 'request_id': 'req-a888879e-628f-427d-98b2-bf30399b7b55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.971572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fa0dfb850545649ffedbac007d8d52', 'request_id': 'req-a888879e-628f-427d-98b2-bf30399b7b55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.984813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] The token cache is being invalidate because project 07fa0dfb850545649ffedbac007d8d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:12:34.985110 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.986084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a888879e-628f-427d-98b2-bf30399b7b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:12:34.987745 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1314/2616] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:12:34 2022] DELETE /identity/v3/projects/07fa0dfb850545649ffedbac007d8d52 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:34.992857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:34.993325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:34.993422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.012493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:35.013987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:35.077558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:35.088016 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1303/2617] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:35.096104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.096390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.096666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.117090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:35.118295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:35.126520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1315/2618] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:35.130734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.140625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc33b1-02e8-47d9-b0cf-81ed7006e231 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.145114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.145766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.146115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.146476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.147325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:12:35.147675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.149411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.162104 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1304/2619] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:12:35.166414 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.176575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4f2a9-3f98-4f14-952b-f7d841fa50d1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.181187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.181783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.182055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.182318 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.182962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.185864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.213358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1316/2620] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:12:35 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:12:35.217993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.228392 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83491-4047-492f-8547-b6825efb2fe1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.290152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.290768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.291046 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.291342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.292039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.294552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.316315 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1305/2621] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:12:35 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:12:35.320488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.330792 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2772-5c16-4bc2-8c92-5ca78a0fbaba admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.335385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.336058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.336334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.336601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.337285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.338895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.348786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1317/2622] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:35.352911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.363424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f12d-d903-4fa6-9697-38b139487688 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.368099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.368710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.368990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.369264 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.369956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.371526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e517-062f-4fbb-b9e1-6c4f03cb01af admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.382913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1306/2623] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:12:35.387396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.397210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2c7c-605b-4d85-8ad3-661f41bd4c88 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.401682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.402326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.402601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.402871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] PATH_INFO: `/v3/projects/01be6fb0c5da442ea7bdca2dcfbf5d9f/users/be5bb575f0de4e2bac7e8042e8969211/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.418164 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01be6fb0c5da442ea7bdca2dcfbf5d9f, user_id=be5bb575f0de4e2bac7e8042e8969211, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.421606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.437295 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1318/2624] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:12:35 2022] PUT /identity/v3/projects/01be6fb0c5da442ea7bdca2dcfbf5d9f/users/be5bb575f0de4e2bac7e8042e8969211/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:12:35.448098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.448098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.448098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.476440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] MFA Rules not processed for user `be5bb575f0de4e2bac7e8042e8969211`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:12:35.477741 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:35.547180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1307/2625] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:12:35.558359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:12:35.560773 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:12:35.637225 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc120ec-7f6e-4ec7-99c4-4673ac419d98 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:12:35.640949 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:12:35.641562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:12:35.641839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:12:35.642111 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:12:35.651981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:12:35.654006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafd5f6-6d56-4f2c-8f05-82c2cd84b23a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:12:35.663184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1319/2626] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:12:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:12:45.540200 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:45.658826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:59.945448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:00.013418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bc059-19f6-4853-abd3-1059409d13bc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:00.018554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:00.019189 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.019587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.019891 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] PATH_INFO: `/v3/users/be5bb575f0de4e2bac7e8042e8969211` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.021040 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5bb575f0de4e2bac7e8042e8969211)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:00.022960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:00.069384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5bb575f0de4e2bac7e8042e8969211'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.076806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5bb575f0de4e2bac7e8042e8969211'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.077503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5bb575f0de4e2bac7e8042e8969211'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.091131 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5bb575f0de4e2bac7e8042e8969211'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.100350 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5bb575f0de4e2bac7e8042e8969211'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.106650 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1308/2627] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:12:59 2022] DELETE /identity/v3/users/be5bb575f0de4e2bac7e8042e8969211 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:00.111384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.112007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.112304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.132204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:00.133571 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:00.197090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1320/2628] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:00.207950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:00.209396 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:00.271429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f507-143f-4266-8c76-0eb4f7898c77 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:00.275028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:00.275630 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.275949 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.276216 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.287328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:00.288812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a74e-2573-43c4-8ba9-90799af6f28c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:00.300389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1309/2629] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:00.614798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:00.616210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:00.654585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324a71f-d451-48a3-bb01-f6c812aa7c98 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:00.661290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:00.661962 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.662263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.662827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] PATH_INFO: `/v3/projects/01be6fb0c5da442ea7bdca2dcfbf5d9f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.663869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01be6fb0c5da442ea7bdca2dcfbf5d9f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:00.665877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:00.730445 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01be6fb0c5da442ea7bdca2dcfbf5d9f', 'request_id': 'req-b20cb9db-9767-4bf6-b66d-dde13166b287'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.738991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01be6fb0c5da442ea7bdca2dcfbf5d9f', 'request_id': 'req-b20cb9db-9767-4bf6-b66d-dde13166b287'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.751546 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01be6fb0c5da442ea7bdca2dcfbf5d9f', 'request_id': 'req-b20cb9db-9767-4bf6-b66d-dde13166b287'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.766105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] The token cache is being invalidate because project 01be6fb0c5da442ea7bdca2dcfbf5d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:00.767193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.767733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b20cb9db-9767-4bf6-b66d-dde13166b287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:00.769278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1321/2630] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:00 2022] DELETE /identity/v3/projects/01be6fb0c5da442ea7bdca2dcfbf5d9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:00.781620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.782643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.782901 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.810157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:00.811468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:00.838410 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:00.906129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1310/2631] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:00.914880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.915165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.915436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.935278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:00.936680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:00.945535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1322/2632] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:00.949733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:00.962756 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5babf3-8f93-4558-a6a2-7f0536ef33e9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:00.967526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:00.968326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:00.968605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:00.968874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:00.969705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:00.970230 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:00.971919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:00.984484 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1311/2633] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:13:00.989984 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:00.999126 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906356-1040-402e-a401-05a312dda0b9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.004661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.005347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.005621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.005915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.006573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.008491 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.039584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1323/2634] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:00 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:01.043750 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:01.053713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1abf3-b337-4f74-bdff-ff982d877246 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.109020 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.109660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.110031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.110385 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.111382 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.113340 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.134575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1312/2635] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:01 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:01.138637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:01.149402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de15ef-bcbb-4d53-ac85-f4a80d3d4ed0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.154000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.154604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.154880 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.155212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.155847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.157514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.167814 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1324/2636] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:01.171668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:01.181575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2334f-c14e-4ce7-9862-8102635984dd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.186146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.186748 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.187026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.187296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.188573 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.190307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5cfba-f637-4065-9470-b73000bba9d9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.200676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1313/2637] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:01.205469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:01.215350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec55d4-e05f-41f1-877c-469393e528ab admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.220593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.221203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.221480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.221754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] PATH_INFO: `/v3/projects/79fd441db7c14cc5ae4d9bb1d9941f15/users/6a7afad8e2704910baa8a64600154ec3/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.237700 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fd441db7c14cc5ae4d9bb1d9941f15, user_id=6a7afad8e2704910baa8a64600154ec3, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.241005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.254201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1325/2638] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:01 2022] PUT /identity/v3/projects/79fd441db7c14cc5ae4d9bb1d9941f15/users/6a7afad8e2704910baa8a64600154ec3/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:01.264307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.264612 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.264882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.294143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] MFA Rules not processed for user `6a7afad8e2704910baa8a64600154ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:01.295593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:01.363730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1314/2639] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:01.375340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:01.377578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:01.401178 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:01.442148 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ced6-3874-4cb7-8fca-a5c13cb22d11 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:01.445904 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:01.446520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:01.446798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:01.447065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:01.456005 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:01.457421 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:01.466593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1326/2640] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:02.684576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:02.685943 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:02.705321 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:02.744130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647b4e-4229-4cc0-a429-f9414b464932 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:02.747624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:02.748259 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:02.748532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:02.748798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:02.751012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:02.809351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:02.811163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c773f-f07f-4434-9941-57d1caf4a310 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:02.820877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1315/2641] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:10.061365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:10.064768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:10.237975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70d83-18ea-43bd-9a58-52d4db05c8a4 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:10.246309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:10.247074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:10.247673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:10.248256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] PATH_INFO: `/v3/users/6fe8ec9c81fc4a0fb1fe3149bc7c3cf3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:10.250686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe8ec9c81fc4a0fb1fe3149bc7c3cf3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:10.255441 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:10.344218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe8ec9c81fc4a0fb1fe3149bc7c3cf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:10.357411 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe8ec9c81fc4a0fb1fe3149bc7c3cf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:10.375039 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe8ec9c81fc4a0fb1fe3149bc7c3cf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:10.400974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe8ec9c81fc4a0fb1fe3149bc7c3cf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:10.426573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe8ec9c81fc4a0fb1fe3149bc7c3cf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:10.445032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1327/2642] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:10 2022] DELETE /identity/v3/users/6fe8ec9c81fc4a0fb1fe3149bc7c3cf3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:10.456452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:10.457445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:10.457914 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:10.483124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:10.484705 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:10.570309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1316/2643] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:10.580694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:10.582518 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:10.701339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:10.718555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ef3c-167d-4468-93b5-d2c7d945cfc9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:10.727139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:10.727754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:10.728099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:10.728375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:10.744534 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:10.746219 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:10.758981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1328/2644] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:10.924198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:10.925738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:11.069305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:11.106645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d24e-8bff-418b-86df-ab8026de17fd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:11.117721 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:11.119180 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:11.119878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:11.121548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:11.125159 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:11.143502 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:11.145639 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:11.159109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1317/2645] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:13:11.555510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:11.557514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:11.571373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a234-89fe-4b87-9227-9143cf63203f service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:11.583021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:11.583835 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:11.584600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:11.584897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] PATH_INFO: `/v3/projects/018bb3888b2d44b791fda70328220868` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:11.586298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] RBAC: Authorizing `identity:delete_project(project_id=018bb3888b2d44b791fda70328220868)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:11.588643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:11.667044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018bb3888b2d44b791fda70328220868', 'request_id': 'req-7a0015f2-9f39-4c1e-be37-3e788c20049d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.674662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018bb3888b2d44b791fda70328220868', 'request_id': 'req-7a0015f2-9f39-4c1e-be37-3e788c20049d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.680662 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018bb3888b2d44b791fda70328220868', 'request_id': 'req-7a0015f2-9f39-4c1e-be37-3e788c20049d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.694253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] The token cache is being invalidate because project 018bb3888b2d44b791fda70328220868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:11.694621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.695256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.699709 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1329/2646] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:11 2022] DELETE /identity/v3/projects/018bb3888b2d44b791fda70328220868 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:11.700970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:11.712825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc350-0a16-4de3-b97d-bec08a846c8d service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:11.778958 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:11.779676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:11.780223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:11.780498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] PATH_INFO: `/v3/users/610e91e9f0704bba9bcf9fe659f8dc77` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:11.781654 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610e91e9f0704bba9bcf9fe659f8dc77)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:11.784374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:11.850241 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610e91e9f0704bba9bcf9fe659f8dc77'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.859509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610e91e9f0704bba9bcf9fe659f8dc77'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.861597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610e91e9f0704bba9bcf9fe659f8dc77'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.880145 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610e91e9f0704bba9bcf9fe659f8dc77'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.894610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e5692f5-f545-405e-a93d-928ea86634d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610e91e9f0704bba9bcf9fe659f8dc77'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:11.902108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1318/2647] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:11 2022] DELETE /identity/v3/users/610e91e9f0704bba9bcf9fe659f8dc77 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:12.421965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:12.423433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:12.436349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0015f2-9f39-4c1e-be37-3e788c20049d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:12.516776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:12.516776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:12.517689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:12.517900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] PATH_INFO: `/v3/projects/77994657c55a4247ab97becf664df713` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:12.519635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77994657c55a4247ab97becf664df713)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:12.521789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:12.581137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77994657c55a4247ab97becf664df713', 'request_id': 'req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:12.588579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77994657c55a4247ab97becf664df713', 'request_id': 'req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:12.596455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77994657c55a4247ab97becf664df713', 'request_id': 'req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:12.629241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:12.638861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] The token cache is being invalidate because project 77994657c55a4247ab97becf664df713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:12.639218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:12.640062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8a30b16f-3e6a-4974-8ccb-d7becdc6dff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:12.647609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1330/2648] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:12 2022] DELETE /identity/v3/projects/77994657c55a4247ab97becf664df713 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:12.648886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:12.649561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:12.650099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:12.701170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:12.704737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:12.800632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:12.801107 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:12.801458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:12.805126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1319/2649] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:12.826366 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:12.829094 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:12.839522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1331/2650] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:12.844181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:12.852344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:12.860678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33843167-92f1-48e5-8ab5-a4e81932925a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:12.871095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:12.871831 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:12.872530 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:12.873577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:12.874373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:12.874797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:12.877151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:12.891836 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1320/2651] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:13:12.895916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:12.905932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffad54-4602-453c-ad04-e101d3b2d6c1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:12.913051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:12.913730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:12.913994 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:12.914285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:12.915043 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:12.917509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:12.980939 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1332/2652] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:12 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:12.985850 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:12.997440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edf455-0ae7-4fb9-b80f-cff01231842f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.043069 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.045358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:13.185365 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f3fb5-7b71-413a-9562-5749b95c8d25 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.187362 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.189170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.191176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.191176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.191455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.193825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.195895 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.196064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.196431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.197027 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.199476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:13.216972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.218971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.232629 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1321/2653] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:12 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:13:13.240535 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.245910 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1333/2654] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:13.254469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385a93-2452-4e55-a582-47f8eadb6183 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.260659 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.261207 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.261672 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.262346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.262767 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.264476 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.282746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1322/2655] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:13.284274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.296638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ede8-358c-4efc-84be-93fad2d9ad5a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.310067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.310845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.311133 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.313523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.315474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.322109 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e9b81-b3fb-4ec8-9b06-487906e489dd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.353681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1334/2656] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:13.357606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.376713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4af1b-9c98-4f37-acbc-ca169a053457 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.387595 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.388307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.388593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.388965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] PATH_INFO: `/v3/projects/29cf2f50ebea4cac84a4938bc5bed9f2/users/9f263678903c4442bbff99be3086bd7b/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.428261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cf2f50ebea4cac84a4938bc5bed9f2, user_id=9f263678903c4442bbff99be3086bd7b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.432117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.460911 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1323/2657] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:13 2022] PUT /identity/v3/projects/29cf2f50ebea4cac84a4938bc5bed9f2/users/9f263678903c4442bbff99be3086bd7b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:13.472026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.472438 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.472818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.525101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] MFA Rules not processed for user `9f263678903c4442bbff99be3086bd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:13.526706 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:13.599591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1335/2658] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:13.604219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.668700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e3cdc-0108-4b4c-a8a1-b7776241a292 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.673697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.674316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.674591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.674863 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.675620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.677671 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.705905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1324/2659] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:13 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:13.709955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.721852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec12f-c656-48f2-869f-ae04959e0046 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.772478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:13.784768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.785679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.785679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.785937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.786602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.788599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.813757 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1336/2660] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:13 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:13:13.815060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.826206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff0f0-5aa3-4f97-bc99-231754dc30f6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.832256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.832866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.833147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.833467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.834169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.835844 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.848928 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1325/2661] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:13.853274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.865600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899c14-1d50-47a8-b544-1fbc4931a4a8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.871033 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.872002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.872271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.872548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] PATH_INFO: `/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d/users/a14e831ebb854f6dab819ab03c3bbd0f/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.889106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28cac67e4d14dfdb5231f9953d8c02d, user_id=a14e831ebb854f6dab819ab03c3bbd0f, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.891942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:13.905610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1337/2662] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:13 2022] PUT /identity/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d/users/a14e831ebb854f6dab819ab03c3bbd0f/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:13.910575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:13.921116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6cc57-0408-4d55-b510-69666adba720 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:13.935328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:13.986793 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:13.988125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:13.988125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:13.988125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:13.988950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:13.990789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd05c42-739a-47a2-8247-0fd75309aa9c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.001198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1326/2663] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:14.005316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:14.017424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aaf50-e0e0-48ab-96f5-a5c74a19e504 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:14.022717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:14.023483 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.023761 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.024113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] PATH_INFO: `/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d/users/a14e831ebb854f6dab819ab03c3bbd0f/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.027132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28cac67e4d14dfdb5231f9953d8c02d, user_id=a14e831ebb854f6dab819ab03c3bbd0f, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:14.030617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.043317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1338/2664] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:14 2022] PUT /identity/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d/users/a14e831ebb854f6dab819ab03c3bbd0f/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:14.054533 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.054839 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.055108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.084397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] MFA Rules not processed for user `a14e831ebb854f6dab819ab03c3bbd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:14.085704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:14.162490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1327/2665] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:14.181114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:14.183626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:14.208951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:14.210861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:14.250234 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369aff-f607-4c15-a12a-a90a45c350d4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:14.254539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:14.255190 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.255464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.255732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.265444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:14.267768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.284083 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1339/2666] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:14.287456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d9eb-91c6-4fb0-afe9-603d275bb1b0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:14.292682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:14.293310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.293584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.293847 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.295984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:14.392440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:14.398050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:14.399526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.410926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1328/2667] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:14.644152 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:14.646424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:14.841304 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0089d-6c5d-429e-a9b6-6bbfe3742802 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:14.849585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:14.850453 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.850828 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.851243 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] PATH_INFO: `/v3/users/6a7afad8e2704910baa8a64600154ec3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.853000 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7afad8e2704910baa8a64600154ec3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:14.856932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.942320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7afad8e2704910baa8a64600154ec3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:14.942959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:14.943961 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7afad8e2704910baa8a64600154ec3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:14.946840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:14.954522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409267fc-f7f4-4f7b-88ad-ed7d57e94845 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:14.961655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:14.962326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.962609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.962971 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] PATH_INFO: `/v3/users/9f263678903c4442bbff99be3086bd7b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:14.964132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f263678903c4442bbff99be3086bd7b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:14.965170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7afad8e2704910baa8a64600154ec3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:14.966072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:14.973934 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7afad8e2704910baa8a64600154ec3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:14.982328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8674362-3b82-43f4-96f0-27eb8e175f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7afad8e2704910baa8a64600154ec3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:14.991920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1340/2668] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:14 2022] DELETE /identity/v3/users/6a7afad8e2704910baa8a64600154ec3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:14.997070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:14.997503 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:14.997862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:15.020780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:15.021993 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:15.026689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f263678903c4442bbff99be3086bd7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:15.036690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f263678903c4442bbff99be3086bd7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:15.037508 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f263678903c4442bbff99be3086bd7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:15.056171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f263678903c4442bbff99be3086bd7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:15.067066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-62387bc6-be19-4b76-a712-8497f3959c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f263678903c4442bbff99be3086bd7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:15.075840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1329/2669] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:14 2022] DELETE /identity/v3/users/9f263678903c4442bbff99be3086bd7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:15.080360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:15.080916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:15.081380 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:15.105186 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:15.106998 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:15.109490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1341/2670] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:15.125078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:15.128582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:15.195961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1330/2671] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:15.198281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c7bca-7d39-4f48-a5a6-eb2b32fb35d4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:15.199749 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:15.258951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:15.260156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:15.260431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:15.260702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:15.269570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659bf64-fcaf-4cd1-816d-346dcada4870 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:15.273436 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:15.274103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:15.274421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:15.274700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:15.274876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:15.274993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:15.285112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:15.285878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1342/2672] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:13:15.286522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:15.296899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1331/2673] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:13:15.980845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:15.982361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.001001 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf048c4-a8af-4b28-81f8-0679ae9f673b service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.006137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.006779 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.007053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.007317 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] PATH_INFO: `/v3/projects/29cf2f50ebea4cac84a4938bc5bed9f2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.008717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cf2f50ebea4cac84a4938bc5bed9f2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.010730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.040359 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:16.044632 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.048459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.077003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a1ff-0e7f-493e-9624-5d5467391d32 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.080853 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cf2f50ebea4cac84a4938bc5bed9f2', 'request_id': 'req-3620f1b7-df78-45f6-95e8-cf4568de7ca1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.084934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:16.089169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cf2f50ebea4cac84a4938bc5bed9f2', 'request_id': 'req-3620f1b7-df78-45f6-95e8-cf4568de7ca1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.099809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cf2f50ebea4cac84a4938bc5bed9f2', 'request_id': 'req-3620f1b7-df78-45f6-95e8-cf4568de7ca1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.118974 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] The token cache is being invalidate because project 29cf2f50ebea4cac84a4938bc5bed9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:16.119256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.121079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.123274 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1343/2674] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:15 2022] DELETE /identity/v3/projects/29cf2f50ebea4cac84a4938bc5bed9f2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:16.128688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.132629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.193053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.193506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.193784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.194053 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] PATH_INFO: `/v3/projects/79fd441db7c14cc5ae4d9bb1d9941f15` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.195578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fd441db7c14cc5ae4d9bb1d9941f15)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.197854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.242464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620f1b7-df78-45f6-95e8-cf4568de7ca1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.248771 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.249456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.249734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.250011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] PATH_INFO: `/v3/users/a14e831ebb854f6dab819ab03c3bbd0f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.251560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14e831ebb854f6dab819ab03c3bbd0f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.253778 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.268945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fd441db7c14cc5ae4d9bb1d9941f15', 'request_id': 'req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.277803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fd441db7c14cc5ae4d9bb1d9941f15', 'request_id': 'req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.289422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fd441db7c14cc5ae4d9bb1d9941f15', 'request_id': 'req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.313947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] The token cache is being invalidate because project 79fd441db7c14cc5ae4d9bb1d9941f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:16.314496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.315179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e1d8ed1a-cc52-4bbb-83ed-ae58a521e7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.317364 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1332/2675] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:16 2022] DELETE /identity/v3/projects/79fd441db7c14cc5ae4d9bb1d9941f15 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:16.322342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.322859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.323254 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.330628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14e831ebb854f6dab819ab03c3bbd0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.331292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14e831ebb854f6dab819ab03c3bbd0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.346590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:16.348723 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.363288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14e831ebb854f6dab819ab03c3bbd0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.376653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14e831ebb854f6dab819ab03c3bbd0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.385896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30b4e5ef-4091-4668-956c-1694d7417a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14e831ebb854f6dab819ab03c3bbd0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:16.410294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1344/2676] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:16 2022] DELETE /identity/v3/users/a14e831ebb854f6dab819ab03c3bbd0f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:16.434150 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1333/2677] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:16.442358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.442668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.443171 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.465086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:16.467391 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.503354 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:16.559920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1345/2678] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:16.563752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.586224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15a72-a10e-4d5e-bb90-12ab396baf6b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.595967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.597152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.597469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.597702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.598571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:16.598926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.600921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.618712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1334/2679] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:13:16.622741 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.634902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d260-30dc-4670-9a17-37d1d900de8f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.639945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.640560 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.641456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.641723 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.642389 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.644943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.695548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1346/2680] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:16 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:16.700506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.726782 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308211c-0ab1-49e5-b389-0859893560d7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.779047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.782120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:16.804328 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:16.893061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.893840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.894735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.894735 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.895394 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.897605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.945480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1335/2681] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:16 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:16.950285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:16.953612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb617-0aca-4d94-aa2e-24170bc5e4da admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.963310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.964652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.965183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.965643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] PATH_INFO: `/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.967016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28cac67e4d14dfdb5231f9953d8c02d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.969582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdfd0-df3c-400d-89b0-d7facceb5e12 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:16.970006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.976325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:16.976946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:16.977222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:16.977490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:16.978183 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:16.980273 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:16.993114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1336/2682] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:13:16.997346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.008609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532462ff-6d2c-4ba0-b406-4097a5749b93 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.015466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.017202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.018334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.018657 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.019699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.023278 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.025818 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28cac67e4d14dfdb5231f9953d8c02d', 'request_id': 'req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:17.034559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28cac67e4d14dfdb5231f9953d8c02d', 'request_id': 'req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:17.040694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1337/2683] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:17.044332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.045355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28cac67e4d14dfdb5231f9953d8c02d', 'request_id': 'req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:17.056613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fffe69-2c74-42dc-b33d-f7d57437bc4c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.062387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] The token cache is being invalidate because project a28cac67e4d14dfdb5231f9953d8c02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:17.062762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:17.063548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0e95cc6b-cd9d-4611-8b1d-8c97d42eec33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:17.069397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1347/2684] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:16 2022] DELETE /identity/v3/projects/a28cac67e4d14dfdb5231f9953d8c02d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:17.071157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52584-3dc8-4695-a3ab-a34f00ac1bf0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.072645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52584-3dc8-4695-a3ab-a34f00ac1bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.073406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52584-3dc8-4695-a3ab-a34f00ac1bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.105276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fdc52584-3dc8-4695-a3ab-a34f00ac1bf0 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:17.106353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fdc52584-3dc8-4695-a3ab-a34f00ac1bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:17.130206 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.130815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.131095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.131372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] PATH_INFO: `/v3/projects/1b1f4e5b364640009733761f8e6960f4/users/12e0db18f89e46c4ac2a8745de468272/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.162636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:17.169693 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1f4e5b364640009733761f8e6960f4, user_id=12e0db18f89e46c4ac2a8745de468272, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.192055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f254e58-7417-451f-92a7-38ff793cb139 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.216192 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1338/2685] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:17 2022] PUT /identity/v3/projects/1b1f4e5b364640009733761f8e6960f4/users/12e0db18f89e46c4ac2a8745de468272/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:17.216426 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1348/2686] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:17.218641 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.219050 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.225758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.232194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.232815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.233201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.254013 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:17.255636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:17.273806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] MFA Rules not processed for user `12e0db18f89e46c4ac2a8745de468272`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:17.275094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:17.341998 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1349/2687] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:17.347125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.357104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adf04d-431b-415f-80cb-b96e60c3815c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.363210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.363875 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.364155 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.364428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.365289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:17.365600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.367184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.373555 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1339/2688] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:17.385548 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.386617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1350/2689] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:13:17.386959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:17.390375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.397160 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:17.401078 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8551-cdc5-4dbc-b7ad-f79252dfaf35 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.405562 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.406167 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.406992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.407262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.408194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.410124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.451517 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1351/2690] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:13:17.455615 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.455982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172ddfc-e5a7-4676-a037-cf413b7681c0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.514244 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.514755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.515029 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.515360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.526186 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524c90-b089-4045-a4ce-9a600e96569f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.531336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.532986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.533270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.533541 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.534198 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.536115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.568405 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1352/2691] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:17.573070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.595244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb0602-b91e-492d-a234-f2300d0406be admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.602915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.603679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.603897 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.604169 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.608442 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.611026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.627659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1353/2692] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:17.628202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.629935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.630104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.648474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950037a4-4b8c-4ecb-8c27-fe73dfdabda1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.656210 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1340/2693] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:13:17.662918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.662918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.662918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.662918 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.664633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.664633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5435-0f43-4938-8c4b-12788fa26d1c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.694269 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1354/2694] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:17.697660 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:17.712117 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134538c-220c-4988-a785-a3f10a233b23 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:17.717166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:17.717973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.718257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.718536 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] PATH_INFO: `/v3/projects/8e5351ccabd846409a2d922663615c5d/users/e85c6a2942284e48a419f029b93a95e7/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.745346 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5351ccabd846409a2d922663615c5d, user_id=e85c6a2942284e48a419f029b93a95e7, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:17.748487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:17.787245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1341/2695] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:17 2022] PUT /identity/v3/projects/8e5351ccabd846409a2d922663615c5d/users/e85c6a2942284e48a419f029b93a95e7/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:17.789129 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:17.789576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:17.789903 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:17.817340 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:17.837798 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] MFA Rules not processed for user `e85c6a2942284e48a419f029b93a95e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:17.839025 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:18.000583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1355/2696] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:18.003436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.103992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:18.119459 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142be4c-0528-4b29-a897-11baf376de60 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.127322 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.128098 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.128378 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.128697 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.129418 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.132442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.183411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1342/2697] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:18 2022] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:18.184612 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.201679 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ae1b0-b2f2-4fde-a10c-712794698a29 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.337417 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.338137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.338484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.338913 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.339548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.342352 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.378912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1356/2698] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:18 2022] POST /identity/v3/users => generated 306 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:18.385158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.399704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba1c-08b2-47f5-bb76-5ea1a417a1a5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.404770 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.405702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.406063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.407107 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.408397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.425187 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.448449 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1343/2699] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:18.452337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.466970 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356ba-2d6d-43e4-8244-52c08b44982c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.478115 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.480310 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.481529 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.481725 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] PATH_INFO: `/v3/projects/63eaa60620be4654857107a209e5dae1/users/ef555fbddfda45758bcd947ebd005099/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.511766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63eaa60620be4654857107a209e5dae1, user_id=ef555fbddfda45758bcd947ebd005099, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.515276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.541890 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1357/2700] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:18 2022] PUT /identity/v3/projects/63eaa60620be4654857107a209e5dae1/users/ef555fbddfda45758bcd947ebd005099/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:18.545889 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.575286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781cd5-1afd-4349-80d4-09b52a8eef61 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.666728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.667422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.667704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.668025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.672925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.678358 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65d55-16a1-46e7-9a68-95d3d1acf23b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.707035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1344/2701] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:18.708666 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:18.735490 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5eec-5571-46b4-83b4-6156364880d8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:18.753634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:18.754539 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.754845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.755218 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] PATH_INFO: `/v3/projects/63eaa60620be4654857107a209e5dae1/users/ef555fbddfda45758bcd947ebd005099/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.757335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63eaa60620be4654857107a209e5dae1, user_id=ef555fbddfda45758bcd947ebd005099, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:18.760355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:18.773638 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1358/2702] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:18 2022] PUT /identity/v3/projects/63eaa60620be4654857107a209e5dae1/users/ef555fbddfda45758bcd947ebd005099/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:18.788620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:18.788620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:18.788620 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:18.825646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] MFA Rules not processed for user `ef555fbddfda45758bcd947ebd005099`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:18.826199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:18.915487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1345/2703] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:18.929901 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:19.030165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a63ca-8cb4-44b8-a4ee-ad6f5e919150 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:19.035206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:19.036928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:19.037209 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:19.037479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:19.047192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:19.053002 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:19.054570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95894ac-a3cf-4fce-83b4-cd7afe436afe service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:19.084144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1359/2704] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:19.180166 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:19.195598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b7b2-f081-44e4-b097-f799ef4207b4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:19.200457 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:19.201684 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:19.202218 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:19.202806 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:19.265922 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:19.279932 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:19.281959 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:19.291875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1346/2705] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:20.284614 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:20.285404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:20.285404 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:20.316229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] MFA Rules not processed for user `00947bb45d374dbba13ef2e02b9ce1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:20.317204 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:20.386668 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1360/2706] 10.222.0.95 () {58 vars in 967 bytes} [Fri Aug 5 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:20.449123 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:20.450689 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:20.529960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3075-d503-4df0-b551-1517fdd18631 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:20.536411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05de568d5ff94ae6a72ce2d795e408de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:20.537039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:20.537317 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:20.537587 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:20.549101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:20.550881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:20.560945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1347/2707] 10.222.0.95 () {60 vars in 1384 bytes} [Fri Aug 5 20:13:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:13:22.275802 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:22.277384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:22.356492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59899a-5e84-4e55-bdd6-1dedfe2590d7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:22.361256 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:22.361898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:22.362306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:22.362699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] PATH_INFO: `/v3/users/69ccb4c3326c47a3ab69bbf5830ab1ef` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:22.363950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ccb4c3326c47a3ab69bbf5830ab1ef)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:22.365999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:22.442205 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ccb4c3326c47a3ab69bbf5830ab1ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.442932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ccb4c3326c47a3ab69bbf5830ab1ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.457680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ccb4c3326c47a3ab69bbf5830ab1ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.465840 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ccb4c3326c47a3ab69bbf5830ab1ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.473865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ccb4c3326c47a3ab69bbf5830ab1ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.480339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1361/2708] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:22 2022] DELETE /identity/v3/users/69ccb4c3326c47a3ab69bbf5830ab1ef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:22.665248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:22.686768 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4bcd-96d3-4bd7-a705-fe26ebf2d992 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:22.780574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:22.782008 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:22.782411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:22.783023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] PATH_INFO: `/v3/projects/ec13d23d483b47f6b8f45c9aedea072a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:22.784561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec13d23d483b47f6b8f45c9aedea072a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:22.786883 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:22.860724 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec13d23d483b47f6b8f45c9aedea072a', 'request_id': 'req-0c33355d-dac2-441f-af7c-ed3f0bfce56f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.876118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec13d23d483b47f6b8f45c9aedea072a', 'request_id': 'req-0c33355d-dac2-441f-af7c-ed3f0bfce56f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.889578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec13d23d483b47f6b8f45c9aedea072a', 'request_id': 'req-0c33355d-dac2-441f-af7c-ed3f0bfce56f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.904539 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] The token cache is being invalidate because project ec13d23d483b47f6b8f45c9aedea072a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:22.904933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.905708 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:22.909039 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1348/2709] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:22 2022] DELETE /identity/v3/projects/ec13d23d483b47f6b8f45c9aedea072a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:22.913146 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:22.916102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:22.927116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:22.934816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14806d30-bf7f-4167-9051-f451980a60ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:23.057130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:23.058052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:23.058480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:23.058763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] PATH_INFO: `/v3/users/3fcb1bcc13744c0eb37670a8b9bfa04b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:23.059982 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcb1bcc13744c0eb37670a8b9bfa04b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:23.061952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:23.130227 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcb1bcc13744c0eb37670a8b9bfa04b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.133825 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcb1bcc13744c0eb37670a8b9bfa04b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.151368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcb1bcc13744c0eb37670a8b9bfa04b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.165423 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcb1bcc13744c0eb37670a8b9bfa04b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.174797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-15fe4d53-c2f4-4748-9062-fce29599423b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcb1bcc13744c0eb37670a8b9bfa04b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.181907 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1362/2710] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:22 2022] DELETE /identity/v3/users/3fcb1bcc13744c0eb37670a8b9bfa04b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:23.383636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:23.385769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:23.400486 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33355d-dac2-441f-af7c-ed3f0bfce56f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:23.404289 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:23.489307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:23.490038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:23.490381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:23.490744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] PATH_INFO: `/v3/projects/eac96adcc17f424399f4d49990d21118` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:23.492055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac96adcc17f424399f4d49990d21118)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:23.494456 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:23.549313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac96adcc17f424399f4d49990d21118', 'request_id': 'req-962af99b-e124-4eba-aebb-6b71afa2d442'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.570308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac96adcc17f424399f4d49990d21118', 'request_id': 'req-962af99b-e124-4eba-aebb-6b71afa2d442'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.577899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac96adcc17f424399f4d49990d21118', 'request_id': 'req-962af99b-e124-4eba-aebb-6b71afa2d442'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.593009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] The token cache is being invalidate because project eac96adcc17f424399f4d49990d21118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:23.594157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.595532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:23.597878 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1349/2711] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:23 2022] DELETE /identity/v3/projects/eac96adcc17f424399f4d49990d21118 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:25.223336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711524-7f12-489b-a83f-56f963ad7ab1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:25.223852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711524-7f12-489b-a83f-56f963ad7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:25.223950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711524-7f12-489b-a83f-56f963ad7ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:25.261617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-78711524-7f12-489b-a83f-56f963ad7ab1 None None] MFA Rules not processed for user `6f89a5e4981e423b84d5f28b33bd9629`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:25.263156 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-78711524-7f12-489b-a83f-56f963ad7ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:25.328509 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1363/2712] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:27.438190 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:27.439913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:27.534865 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af99b-e124-4eba-aebb-6b71afa2d442 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:27.541979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:27.542665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:27.542991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:27.543263 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] PATH_INFO: `/v3/users/12e0db18f89e46c4ac2a8745de468272` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:27.544797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e0db18f89e46c4ac2a8745de468272)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:27.549468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:27.606099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:27.616311 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e0db18f89e46c4ac2a8745de468272'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:27.626903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e0db18f89e46c4ac2a8745de468272'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:27.627803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e0db18f89e46c4ac2a8745de468272'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:27.646951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e0db18f89e46c4ac2a8745de468272'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:27.658129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e0db18f89e46c4ac2a8745de468272'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:27.666075 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1350/2713] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:27 2022] DELETE /identity/v3/users/12e0db18f89e46c4ac2a8745de468272 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:27.670564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:27.671047 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:27.671194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:27.694520 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:27.695850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:27.727049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:27.793959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1364/2714] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:27.804433 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:27.806006 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:27.875277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9152f7b-736c-468c-a668-1f8cb577a845 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:27.879146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:27.882962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:27.882962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:27.882962 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:27.891248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:27.892965 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48609a-226a-40d3-b7e6-b21b77d2c1c4 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:27.908788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1351/2715] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:28.168882 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:28.172270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:28.197789 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a93-df51-49b3-8a3f-b880622a52a5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:28.205394 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:28.206610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:28.208040 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:28.208852 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] PATH_INFO: `/v3/users/e85c6a2942284e48a419f029b93a95e7` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:28.211616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85c6a2942284e48a419f029b93a95e7)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:28.214703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:28.311625 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85c6a2942284e48a419f029b93a95e7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.312588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85c6a2942284e48a419f029b93a95e7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.393131 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85c6a2942284e48a419f029b93a95e7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.405877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85c6a2942284e48a419f029b93a95e7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.429636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85c6a2942284e48a419f029b93a95e7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.442588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1365/2716] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:28 2022] DELETE /identity/v3/users/e85c6a2942284e48a419f029b93a95e7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:28.447342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:28.447946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:28.447946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:28.488591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:28.490018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:28.582106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1352/2717] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:28.627839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:28.630261 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:28.709399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:28.711065 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:28.730526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4440fe-87f8-4ddc-a490-fccd1da7447d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:28.739862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:28.740328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3383-5013-4d62-8592-8fed5d85ffa3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:28.740815 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:28.740948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:28.741228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] PATH_INFO: `/v3/projects/1b1f4e5b364640009733761f8e6960f4` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:28.745929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:28.746854 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:28.747224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1f4e5b364640009733761f8e6960f4)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:28.747451 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:28.747878 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:28.749773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:28.759183 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:28.766937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:28.789132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1366/2718] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:28.865308 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1f4e5b364640009733761f8e6960f4', 'request_id': 'req-19e79211-50d5-432e-9007-3ffdceff1c13'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.870509 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:28.884262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1f4e5b364640009733761f8e6960f4', 'request_id': 'req-19e79211-50d5-432e-9007-3ffdceff1c13'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.892526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1f4e5b364640009733761f8e6960f4', 'request_id': 'req-19e79211-50d5-432e-9007-3ffdceff1c13'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.909987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] The token cache is being invalidate because project 1b1f4e5b364640009733761f8e6960f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:28.910329 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.911236 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:28.928730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1353/2719] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:28 2022] DELETE /identity/v3/projects/1b1f4e5b364640009733761f8e6960f4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:29.425098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:29.427188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:29.441833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e17b-3845-4e4a-a9ce-077dc1a554f4 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:29.500163 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:29.522251 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:29.522937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:29.523346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:29.523629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] PATH_INFO: `/v3/users/44c083ae1c5a4444a55ecb26cfdd58ca` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:29.525153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c083ae1c5a4444a55ecb26cfdd58ca)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:29.527143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:29.541490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:29.543526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:29.580109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e79211-50d5-432e-9007-3ffdceff1c13 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:29.585338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:29.585984 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:29.586258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:29.586540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] PATH_INFO: `/v3/projects/8e5351ccabd846409a2d922663615c5d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:29.587682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5351ccabd846409a2d922663615c5d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:29.589669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:29.595220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c083ae1c5a4444a55ecb26cfdd58ca'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.596487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c083ae1c5a4444a55ecb26cfdd58ca'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.609573 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c083ae1c5a4444a55ecb26cfdd58ca'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.616935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c083ae1c5a4444a55ecb26cfdd58ca'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.629846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c083ae1c5a4444a55ecb26cfdd58ca'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.638294 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1367/2720] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:29 2022] DELETE /identity/v3/users/44c083ae1c5a4444a55ecb26cfdd58ca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:29.667172 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5351ccabd846409a2d922663615c5d', 'request_id': 'req-4d283e01-168e-42e3-a974-5f4c3708c741'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.677202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5351ccabd846409a2d922663615c5d', 'request_id': 'req-4d283e01-168e-42e3-a974-5f4c3708c741'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.693810 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5351ccabd846409a2d922663615c5d', 'request_id': 'req-4d283e01-168e-42e3-a974-5f4c3708c741'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.710228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] The token cache is being invalidate because project 8e5351ccabd846409a2d922663615c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:29.710592 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.711591 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.713652 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1354/2721] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:29 2022] DELETE /identity/v3/projects/8e5351ccabd846409a2d922663615c5d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:29.717603 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:29.719968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:29.802373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c4d8-a804-4a3e-9044-ddabb4425edd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:29.867748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:29.868719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:29.869199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:29.869659 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] PATH_INFO: `/v3/users/ef555fbddfda45758bcd947ebd005099` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:29.871241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef555fbddfda45758bcd947ebd005099)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:29.873521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:29.893089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:29.949520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:29.950997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:29.972201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d283e01-168e-42e3-a974-5f4c3708c741 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:29.974684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef555fbddfda45758bcd947ebd005099'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.975480 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef555fbddfda45758bcd947ebd005099'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:29.978478 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:29.980613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:29.981126 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:29.981640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] PATH_INFO: `/v3/projects/c8dacae2d58843f2b1b8b532759b83ee` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:29.983103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dacae2d58843f2b1b8b532759b83ee)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:29.987268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:29.993705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef555fbddfda45758bcd947ebd005099'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.008195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef555fbddfda45758bcd947ebd005099'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.017521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef555fbddfda45758bcd947ebd005099'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.029805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1368/2722] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:29 2022] DELETE /identity/v3/users/ef555fbddfda45758bcd947ebd005099 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:30.053435 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dacae2d58843f2b1b8b532759b83ee', 'request_id': 'req-97f09928-30bf-4801-a5af-6376be506d0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.062667 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dacae2d58843f2b1b8b532759b83ee', 'request_id': 'req-97f09928-30bf-4801-a5af-6376be506d0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.070333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dacae2d58843f2b1b8b532759b83ee', 'request_id': 'req-97f09928-30bf-4801-a5af-6376be506d0b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.084532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] The token cache is being invalidate because project c8dacae2d58843f2b1b8b532759b83ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:30.085437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.085563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.087638 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1355/2723] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:29 2022] DELETE /identity/v3/projects/c8dacae2d58843f2b1b8b532759b83ee => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:30.091860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:30.093649 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:30.188101 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb43475-eccc-4919-b02d-60dbb88bff37 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:30.301433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:30.302299 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:30.302559 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:30.302915 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] PATH_INFO: `/v3/users/d711ce824a0c472796515517621de589` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:30.304396 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d711ce824a0c472796515517621de589)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:30.306645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:30.350753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:30.361932 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd711ce824a0c472796515517621de589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.363026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd711ce824a0c472796515517621de589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.380749 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd711ce824a0c472796515517621de589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.388252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd711ce824a0c472796515517621de589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.398337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce81adeb-b1e2-41ab-8159-84074d8b4ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd711ce824a0c472796515517621de589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.411850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1369/2724] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:30 2022] DELETE /identity/v3/users/d711ce824a0c472796515517621de589 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:30.533518 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:30.534964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:30.553430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09928-30bf-4801-a5af-6376be506d0b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:30.615877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:30.647161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:30.648202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:30.648202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:30.648424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] PATH_INFO: `/v3/projects/63eaa60620be4654857107a209e5dae1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:30.649746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63eaa60620be4654857107a209e5dae1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:30.651713 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:30.720460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63eaa60620be4654857107a209e5dae1', 'request_id': 'req-d682d517-1fb3-452f-aca3-cc910f8ac344'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.744575 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63eaa60620be4654857107a209e5dae1', 'request_id': 'req-d682d517-1fb3-452f-aca3-cc910f8ac344'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.761758 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63eaa60620be4654857107a209e5dae1', 'request_id': 'req-d682d517-1fb3-452f-aca3-cc910f8ac344'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.779223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] The token cache is being invalidate because project 63eaa60620be4654857107a209e5dae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:30.779559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.780257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:30.783438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1356/2725] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:30 2022] DELETE /identity/v3/projects/63eaa60620be4654857107a209e5dae1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:30.788827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b9ca-ad9a-48a9-b334-32d168707d38 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:30.789669 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b9ca-ad9a-48a9-b334-32d168707d38 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:30.789971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b9ca-ad9a-48a9-b334-32d168707d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:30.813728 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6265b9ca-ad9a-48a9-b334-32d168707d38 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:30.814971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6265b9ca-ad9a-48a9-b334-32d168707d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:30.845069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:30.846512 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:30.938952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1370/2726] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:30.952538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231efc-9627-4875-9848-b604986daf78 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:30.957104 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231efc-9627-4875-9848-b604986daf78 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:30.957717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231efc-9627-4875-9848-b604986daf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:30.977634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d517-1fb3-452f-aca3-cc910f8ac344 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:30.992698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:30.993504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:30.993624 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:30.993895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] PATH_INFO: `/v3/projects/ecf9c8aac1ab457187a1398aab348da8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:30.995559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf9c8aac1ab457187a1398aab348da8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:30.997487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.007286 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e4231efc-9627-4875-9848-b604986daf78 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:31.009019 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e4231efc-9627-4875-9848-b604986daf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:31.020512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1371/2727] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:31.024329 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4231efc-9627-4875-9848-b604986daf78 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.038271 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4231efc-9627-4875-9848-b604986daf78 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.044138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.044810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.045154 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.045444 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.046327 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:31.046764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.048975 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.065973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1372/2728] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:13:31.066863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.072305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf9c8aac1ab457187a1398aab348da8', 'request_id': 'req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:31.078735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abde2-71d8-4ad9-88d5-4b8dce5d2afd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.083877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf9c8aac1ab457187a1398aab348da8', 'request_id': 'req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:31.092859 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf9c8aac1ab457187a1398aab348da8', 'request_id': 'req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:31.105875 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] The token cache is being invalidate because project ecf9c8aac1ab457187a1398aab348da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:31.106277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:31.107154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:31.112100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1357/2729] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:30 2022] DELETE /identity/v3/projects/ecf9c8aac1ab457187a1398aab348da8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:31.150680 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.152068 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.152530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.152810 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.153514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.155758 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.190593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1373/2730] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:31 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:31.194582 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.197853 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:31.213801 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9553a6-f8bd-48db-a4fa-7da3d9d63ed8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.222047 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:31.333013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.334178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.334616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.335344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.346898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.356835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.399964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1358/2731] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:31 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:13:31.400208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.411660 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc675-8bf8-4617-8532-53c677278815 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.425168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.425844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.426052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.426349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.428059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.430670 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.445285 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1374/2732] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:13:31.448607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.463312 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01913ac-5d51-45f7-9889-56aea692a5d1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.470167 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.470919 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.471265 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.471598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.472426 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.474001 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b050b-d931-460f-a96e-3edc96ad3e06 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.484580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1359/2733] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:31.488782 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.498972 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ba43-ea97-4a72-aeda-d511d38090a6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.504150 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.504817 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.505090 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.505360 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] PATH_INFO: `/v3/projects/615eaf12564c40bf897ef00271816167/users/4e736095d3044c4f99893c9cffb9e031/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.508712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:31.523851 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615eaf12564c40bf897ef00271816167, user_id=4e736095d3044c4f99893c9cffb9e031, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.526568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.541611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1375/2734] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:31 2022] PUT /identity/v3/projects/615eaf12564c40bf897ef00271816167/users/4e736095d3044c4f99893c9cffb9e031/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:31.551995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.552491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.552835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.584603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] MFA Rules not processed for user `4e736095d3044c4f99893c9cffb9e031`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:31.586881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:31.667467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1360/2735] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:31.672856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.732661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e2e43-7446-42c2-b925-91b66b7ae919 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.738313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.738929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.739208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.739479 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.740185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.742065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.768165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1376/2736] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:31 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:31.772228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.783451 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868947-4ee3-44b4-985d-72f1e220525b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.837505 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.838106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.838399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.838646 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.839286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.841245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.864310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1361/2737] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:31 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:31.868449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.881009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79d723-9938-4b82-8900-5777adf60ac3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.886456 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.887253 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.887633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.888059 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.888945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.891092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.902326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1377/2738] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:13:31.907727 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.918133 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab23f-bdee-4033-a771-cdda267e4d94 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:31.923634 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:31.924331 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:31.924610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:31.925307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] PATH_INFO: `/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510/users/302893c74c1343e6a0e0addfe08e8abc/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:31.927584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:31.943301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d458ebc3d8d40f0bbd3a0f049800510, user_id=302893c74c1343e6a0e0addfe08e8abc, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:31.945961 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:31.961050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1362/2739] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:31 2022] PUT /identity/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510/users/302893c74c1343e6a0e0addfe08e8abc/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:31.965103 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:31.976719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081859-14ad-4a67-b15a-630d8f609be6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:32.040739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:32.041552 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:32.042336 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:32.042617 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:32.043353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:32.044960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6bf6-fc58-4b51-a4d7-ce8f664a2a15 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:32.059877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1378/2740] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:32.062944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:32.073855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6fd0-8352-49c0-9bc3-c83fa0078d79 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:32.079344 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:32.080051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:32.080332 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:32.080613 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] PATH_INFO: `/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510/users/302893c74c1343e6a0e0addfe08e8abc/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:32.082738 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d458ebc3d8d40f0bbd3a0f049800510, user_id=302893c74c1343e6a0e0addfe08e8abc, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:32.085403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:32.096899 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1363/2741] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:32 2022] PUT /identity/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510/users/302893c74c1343e6a0e0addfe08e8abc/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:32.108399 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:32.109270 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:32.110584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:32.142079 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] MFA Rules not processed for user `302893c74c1343e6a0e0addfe08e8abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:32.143305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:32.186275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:32.214511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1379/2742] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:32.226679 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:32.228387 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:32.289222 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962f91-6d44-45d4-bd99-ad8e7c6bece8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:32.292828 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:32.293440 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:32.293716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:32.293987 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:32.303574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:32.305021 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236b89-c5e6-45b2-9402-3c49a29cba8a service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:32.315680 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1364/2743] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:32.865008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:32.927737 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773cefb-d28b-4008-b43b-4bbcc7bb07d4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:32.932385 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:32.932958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:32.933235 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:32.933508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] PATH_INFO: `/v3/users/4e736095d3044c4f99893c9cffb9e031` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:32.934675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e736095d3044c4f99893c9cffb9e031)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:32.936636 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:32.982323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e736095d3044c4f99893c9cffb9e031'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:32.982969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e736095d3044c4f99893c9cffb9e031'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:32.994807 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e736095d3044c4f99893c9cffb9e031'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.001637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e736095d3044c4f99893c9cffb9e031'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.009159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e736095d3044c4f99893c9cffb9e031'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.015752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1380/2744] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:32 2022] DELETE /identity/v3/users/4e736095d3044c4f99893c9cffb9e031 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:33.020367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:33.020840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:33.020927 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:33.040854 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:33.042051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:33.098916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1365/2745] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:33.109176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:33.110733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:33.173572 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d6d7-1df8-4eeb-8e49-4be646d1d485 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:33.177589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:33.178350 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:33.178634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:33.178906 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:33.189386 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:33.190786 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:33.201533 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1381/2746] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:33.561645 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:33.564132 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:33.578389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5741-1a4c-43c9-a3a9-a45bd178b7d1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:33.583293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:33.584083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:33.584425 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:33.584751 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] PATH_INFO: `/v3/projects/615eaf12564c40bf897ef00271816167` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:33.585994 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615eaf12564c40bf897ef00271816167)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:33.587986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:33.640702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615eaf12564c40bf897ef00271816167', 'request_id': 'req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.648335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615eaf12564c40bf897ef00271816167', 'request_id': 'req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.654692 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615eaf12564c40bf897ef00271816167', 'request_id': 'req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.656807 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:33.668477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] The token cache is being invalidate because project 615eaf12564c40bf897ef00271816167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:33.669027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.669789 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.673050 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1366/2747] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:33 2022] DELETE /identity/v3/projects/615eaf12564c40bf897ef00271816167 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:33.677093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:33.682011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:33.689229 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c4c-f557-46f6-9d1a-c2325179c07c service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:33.750908 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:33.751566 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:33.751898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:33.752177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] PATH_INFO: `/v3/users/302893c74c1343e6a0e0addfe08e8abc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:33.753378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302893c74c1343e6a0e0addfe08e8abc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:33.755464 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:33.801361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302893c74c1343e6a0e0addfe08e8abc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.801999 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302893c74c1343e6a0e0addfe08e8abc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.814297 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302893c74c1343e6a0e0addfe08e8abc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.821787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302893c74c1343e6a0e0addfe08e8abc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.829508 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-07dabdf9-0ed3-49ab-893e-8b36d6bb9a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302893c74c1343e6a0e0addfe08e8abc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:33.835950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1382/2748] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:33 2022] DELETE /identity/v3/users/302893c74c1343e6a0e0addfe08e8abc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:34.109934 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.111355 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:34.124161 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34f7a-4428-44d7-bb29-44fe0bab7ef5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.181389 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.182052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.182325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.182589 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] PATH_INFO: `/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.183747 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d458ebc3d8d40f0bbd3a0f049800510)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.185643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.231423 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d458ebc3d8d40f0bbd3a0f049800510', 'request_id': 'req-6e0a8efa-ed69-45a6-adba-97589b085e7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:34.239564 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d458ebc3d8d40f0bbd3a0f049800510', 'request_id': 'req-6e0a8efa-ed69-45a6-adba-97589b085e7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:34.246247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d458ebc3d8d40f0bbd3a0f049800510', 'request_id': 'req-6e0a8efa-ed69-45a6-adba-97589b085e7b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:34.257026 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] The token cache is being invalidate because project 1d458ebc3d8d40f0bbd3a0f049800510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:34.257307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:34.257924 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e0a8efa-ed69-45a6-adba-97589b085e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:34.259403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1367/2749] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:34 2022] DELETE /identity/v3/projects/1d458ebc3d8d40f0bbd3a0f049800510 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:34.265298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.265945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.265945 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.285739 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:34.286927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:34.343752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1383/2750] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:34.352099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.352513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.352895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.372527 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:34.373698 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:34.381467 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1368/2751] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:34.385579 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.396293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c98ae-f307-4b0e-94f3-35185a652fce None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.400557 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.401159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.401433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.401703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.402403 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:34.402683 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.404273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.417876 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1384/2752] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:13:34.422269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.431746 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab790557-de7a-4e48-b0d8-33484c8d022b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.436506 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.437352 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.437618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.437886 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.438541 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.440442 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.467608 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1369/2753] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:34.472543 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.482686 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b3fe-9830-4253-898e-872ff2ddeb14 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.487635 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:34.541470 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.542089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.542363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.542633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.543293 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.545249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.566410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1385/2754] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:34.570549 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.581413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160139-c512-4786-9996-574cc4f8f3e4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.585964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.586562 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.586837 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.587106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.587820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.589397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.600128 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1370/2755] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:34.604032 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.614525 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c825919-5315-4253-98bb-5a5fc611e989 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.619416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.620054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.620328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.620620 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.621307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.622892 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c914c6-f8ea-4093-b54c-2289238d5539 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.634392 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1386/2756] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:34.638532 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.649108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65864bc-71ea-486f-a6e1-6722606751ab admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.653668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.654323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.654597 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.654866 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] PATH_INFO: `/v3/projects/07c7eeb855d741c2b6f81a08dab6646b/users/838e39b2df31422998196fbbd1d26773/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.670422 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c7eeb855d741c2b6f81a08dab6646b, user_id=838e39b2df31422998196fbbd1d26773, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.673106 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.688762 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1371/2757] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:34 2022] PUT /identity/v3/projects/07c7eeb855d741c2b6f81a08dab6646b/users/838e39b2df31422998196fbbd1d26773/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:34.699065 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.699349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.699621 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.727289 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] MFA Rules not processed for user `838e39b2df31422998196fbbd1d26773`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:34.728536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:34.800114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1387/2758] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:34.804607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.831558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:34.872623 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108372b8-7a70-4521-9860-c1c1ded0b5bf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.877952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.878572 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.878852 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.879122 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.879823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.881715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:34.910678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1372/2759] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:34.914654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:34.925606 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c646a-25f0-4cac-bc56-fc3c8b50edf2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:34.992705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:34.993245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:34.993530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:34.993801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:34.994473 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:34.996416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.018006 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1388/2760] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:34 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:35.021983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.032368 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2409-9360-4376-96cf-f6db8b079b86 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.037201 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.037797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.038072 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.038341 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.039038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.040668 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.051805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1373/2761] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:35.055703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.066439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c2d00-cdf0-421b-aa10-ca302e937d3c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.071199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.071808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.072084 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.072349 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.073030 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.074591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef36e43-213f-480c-a30b-c846a8d82a26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.075839 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:35.086361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1389/2762] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:35.090474 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.102037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d18ad3-869f-40a7-aadc-c22df606d727 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.106812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.107493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.107766 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.108060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] PATH_INFO: `/v3/projects/822dc5007e3c4cafb9ffe96f614ad409/users/8efabc15a26e4ad1a3fb6a5b88f84f5b/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.123202 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822dc5007e3c4cafb9ffe96f614ad409, user_id=8efabc15a26e4ad1a3fb6a5b88f84f5b, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.126580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.139686 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1374/2763] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:35 2022] PUT /identity/v3/projects/822dc5007e3c4cafb9ffe96f614ad409/users/8efabc15a26e4ad1a3fb6a5b88f84f5b/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:35.205564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.205845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.206120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.233334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] MFA Rules not processed for user `8efabc15a26e4ad1a3fb6a5b88f84f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:35.235302 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:35.299846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1390/2764] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:35.304471 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.365996 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7b961-3636-48ae-b710-96f0a5b71f17 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.370605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.371212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.371488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.371757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.372447 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.374995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.400773 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1375/2765] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:35 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:35.404846 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.416357 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ab7a-6c98-4318-8d34-d378106e9e06 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.475056 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.475647 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.475951 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.476220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.476860 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.478743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.501896 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1391/2766] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:35 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:35.503601 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.513787 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecffb9-10bc-4fbf-aa7c-e57c40f5f9b0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.519112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.519710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.520018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.520286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.520972 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.522544 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.533846 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1376/2767] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:35.537953 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.548378 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232ac5-2e99-4a9f-a2f2-69059ca4c287 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.554238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.554682 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.554919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.555284 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] PATH_INFO: `/v3/projects/0f4914a922f840e0addf54fdbdfc30fd/users/6837caf579754fe0946f77793ba65b21/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.571159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4914a922f840e0addf54fdbdfc30fd, user_id=6837caf579754fe0946f77793ba65b21, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.573797 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.587465 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1392/2768] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:35 2022] PUT /identity/v3/projects/0f4914a922f840e0addf54fdbdfc30fd/users/6837caf579754fe0946f77793ba65b21/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:35.591618 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.602153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cda3d-6184-4606-bbc1-8e711210c790 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.646103 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:35.659860 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.660481 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.660763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.661027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.661710 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.663281 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bedfc7-d8d5-44ea-af50-6789fa314da1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.673168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1377/2769] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:35.677542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.688102 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95a67-5ac4-4c15-8365-e52591930129 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.692632 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.693278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.693554 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.693820 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] PATH_INFO: `/v3/projects/0f4914a922f840e0addf54fdbdfc30fd/users/6837caf579754fe0946f77793ba65b21/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.695734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4914a922f840e0addf54fdbdfc30fd, user_id=6837caf579754fe0946f77793ba65b21, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.698342 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.709009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1393/2770] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:35 2022] PUT /identity/v3/projects/0f4914a922f840e0addf54fdbdfc30fd/users/6837caf579754fe0946f77793ba65b21/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:35.719095 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.719379 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.719656 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.747062 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] MFA Rules not processed for user `6837caf579754fe0946f77793ba65b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:35.748296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:35.816795 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1378/2771] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:35.828135 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:35.829827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:35.871345 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:35.888012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dc7d-c327-4de3-bc5e-587156301b92 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:35.891754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:35.892428 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:35.892697 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:35.892960 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:35.950578 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:35.952015 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:35.962058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1394/2772] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:37.465570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:37.466925 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:37.483419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fabd-f009-43f8-b7f1-62bd3bdc7ee2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:37.487069 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58433340-125c-4878-9a04-6647395b186a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:37.487636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433340-125c-4878-9a04-6647395b186a service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:37.487921 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433340-125c-4878-9a04-6647395b186a service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:37.488205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433340-125c-4878-9a04-6647395b186a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:37.545146 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58433340-125c-4878-9a04-6647395b186a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:37.546584 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58433340-125c-4878-9a04-6647395b186a service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:37.555797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1379/2773] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:38.091140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:38.100149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310d78-b024-41d4-82d2-c1018312933e service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:38.103712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:38.104355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:38.104626 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:38.104914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:38.114476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:38.115909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8f941-c8b3-4367-8707-acf4cf3093ab service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:38.126263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1395/2774] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:42.044245 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58433340-125c-4878-9a04-6647395b186a service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:42.113888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58433340-125c-4878-9a04-6647395b186a service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:42.118349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:42.118976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:42.119251 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:42.119516 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] PATH_INFO: `/v3/users/838e39b2df31422998196fbbd1d26773` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:42.120765 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838e39b2df31422998196fbbd1d26773)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:42.122655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:42.128434 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:42.172074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838e39b2df31422998196fbbd1d26773'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.178676 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838e39b2df31422998196fbbd1d26773'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.179333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838e39b2df31422998196fbbd1d26773'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.190872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838e39b2df31422998196fbbd1d26773'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.198152 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838e39b2df31422998196fbbd1d26773'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.204193 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1380/2775] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:42 2022] DELETE /identity/v3/users/838e39b2df31422998196fbbd1d26773 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:42.208760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:42.209591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:42.209869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:42.229008 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:42.230195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:42.289093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1396/2776] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:42.299477 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:42.300990 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:42.356269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbddd69-c5bb-44e9-b09d-c0cff184bc44 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:42.360715 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:42.361325 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:42.361603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:42.361874 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:42.370864 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:42.372303 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:42.381861 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1381/2777] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:42.650332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:42.651803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:42.666760 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678583b4-650b-4a38-b28a-aa72739b004b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:42.671575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:42.672246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:42.672522 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:42.672790 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] PATH_INFO: `/v3/projects/07c7eeb855d741c2b6f81a08dab6646b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:42.673933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c7eeb855d741c2b6f81a08dab6646b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:42.675844 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:42.723128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c7eeb855d741c2b6f81a08dab6646b', 'request_id': 'req-42641841-6cef-44e2-8298-6d14910649fc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.729176 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c7eeb855d741c2b6f81a08dab6646b', 'request_id': 'req-42641841-6cef-44e2-8298-6d14910649fc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.734764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c7eeb855d741c2b6f81a08dab6646b', 'request_id': 'req-42641841-6cef-44e2-8298-6d14910649fc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.747086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] The token cache is being invalidate because project 07c7eeb855d741c2b6f81a08dab6646b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:42.747371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.747995 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.750003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1397/2778] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:42 2022] DELETE /identity/v3/projects/07c7eeb855d741c2b6f81a08dab6646b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:42.754018 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:42.763581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19558363-7f0e-4fe2-b8be-14a0a8ef2a11 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:42.818755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:42.819301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:42.819578 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:42.819882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] PATH_INFO: `/v3/users/8efabc15a26e4ad1a3fb6a5b88f84f5b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:42.821032 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efabc15a26e4ad1a3fb6a5b88f84f5b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:42.822946 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:42.856370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:42.870759 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efabc15a26e4ad1a3fb6a5b88f84f5b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.879980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efabc15a26e4ad1a3fb6a5b88f84f5b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.880688 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efabc15a26e4ad1a3fb6a5b88f84f5b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.893460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efabc15a26e4ad1a3fb6a5b88f84f5b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.900905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efabc15a26e4ad1a3fb6a5b88f84f5b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:42.907915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1382/2779] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:42 2022] DELETE /identity/v3/users/8efabc15a26e4ad1a3fb6a5b88f84f5b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:43.184772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:43.187433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:43.200783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:43.208979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641841-6cef-44e2-8298-6d14910649fc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:43.277093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:43.277736 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:43.278009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:43.278278 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] PATH_INFO: `/v3/projects/822dc5007e3c4cafb9ffe96f614ad409` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:43.279600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822dc5007e3c4cafb9ffe96f614ad409)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:43.282330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:43.333108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822dc5007e3c4cafb9ffe96f614ad409', 'request_id': 'req-ed950aa4-d2f2-40b1-b502-1e60ba395d55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.339678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822dc5007e3c4cafb9ffe96f614ad409', 'request_id': 'req-ed950aa4-d2f2-40b1-b502-1e60ba395d55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.346051 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822dc5007e3c4cafb9ffe96f614ad409', 'request_id': 'req-ed950aa4-d2f2-40b1-b502-1e60ba395d55'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.359748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] The token cache is being invalidate because project 822dc5007e3c4cafb9ffe96f614ad409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:43.360086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.360707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.362249 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1398/2780] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:43 2022] DELETE /identity/v3/projects/822dc5007e3c4cafb9ffe96f614ad409 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:43.366310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:43.368073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:43.381076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaffde5-3d05-4896-bb9e-af4fe49342fd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:43.449955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:43.450600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:43.450877 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:43.451147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] PATH_INFO: `/v3/users/6837caf579754fe0946f77793ba65b21` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:43.452979 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6837caf579754fe0946f77793ba65b21)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:43.454888 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:43.466437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:43.468074 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:43.506175 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6837caf579754fe0946f77793ba65b21'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.515881 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6837caf579754fe0946f77793ba65b21'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.516907 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6837caf579754fe0946f77793ba65b21'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.532208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6837caf579754fe0946f77793ba65b21'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.533325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950aa4-d2f2-40b1-b502-1e60ba395d55 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:43.538187 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:43.538938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:43.539323 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:43.539653 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:43.541809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:43.543880 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6837caf579754fe0946f77793ba65b21'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:43.557088 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1383/2781] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:13:43 2022] DELETE /identity/v3/users/6837caf579754fe0946f77793ba65b21 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:13:43.596743 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:43.618902 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:43.620368 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3346b-ca28-43a8-a0e5-c85649503375 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:43.630973 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1399/2782] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:13:44.020429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.022023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:44.066461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:44.106915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1735d-637c-49b1-bf59-2e1ed50ed92d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.111647 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.112337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.112609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.112879 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] PATH_INFO: `/v3/projects/0f4914a922f840e0addf54fdbdfc30fd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.114130 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4914a922f840e0addf54fdbdfc30fd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.116049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.164487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4914a922f840e0addf54fdbdfc30fd', 'request_id': 'req-edc065ab-b6aa-4510-aa72-9dab11c2cd31'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:44.173452 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4914a922f840e0addf54fdbdfc30fd', 'request_id': 'req-edc065ab-b6aa-4510-aa72-9dab11c2cd31'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:44.180973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4914a922f840e0addf54fdbdfc30fd', 'request_id': 'req-edc065ab-b6aa-4510-aa72-9dab11c2cd31'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:44.193114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] The token cache is being invalidate because project 0f4914a922f840e0addf54fdbdfc30fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:13:44.193399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:44.194044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-edc065ab-b6aa-4510-aa72-9dab11c2cd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:13:44.195565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1384/2783] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:13:44 2022] DELETE /identity/v3/projects/0f4914a922f840e0addf54fdbdfc30fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:44.200805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.201092 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.201367 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.223474 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:44.224772 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:44.292344 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1400/2784] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:13:44.302024 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.302306 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.302581 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.324118 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:44.325330 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:44.333910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1385/2785] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:44.338513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.349120 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f598f-b3fb-4d3f-9216-d68f99d53a70 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.353751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.354380 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.354657 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.354930 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.355630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:13:44.356026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.357630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.371585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1401/2786] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:13:44.376840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.386916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f888-fa43-4055-bd0f-492a34e65d54 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.392063 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.392772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.393049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.393314 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.393982 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.395893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.427334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1386/2787] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:13:44 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:13:44.432066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.442733 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c6f5-4545-4fbb-87af-ab685f8d0327 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.503433 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.504596 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.504873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.505144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.505816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.507767 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.531016 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1402/2788] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:13:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:13:44.535609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.547619 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce325e-3d2f-457a-9b69-a9e4372f1484 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.552491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.553116 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.553399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.553669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.554374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.556009 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.567258 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1387/2789] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:44.571787 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.582928 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21f70-6a69-4dd6-b432-2ee2679e7d51 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.587763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.588416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.588689 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.588957 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.589658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.591276 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79e49c-e45a-454b-9cbc-0ed7f5a022fb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.603847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1403/2790] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:13:44.608999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.619155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173444-b6f5-430d-bb4e-b2957ccb34af admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.623862 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.624528 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.624803 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.625071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] PATH_INFO: `/v3/projects/bd8e07dc452141c5ad445b9eb808369d/users/317c4b7b042c476f88282b29949001a4/roles/2c8acee661db441aae043379c7020618` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.640141 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e07dc452141c5ad445b9eb808369d, user_id=317c4b7b042c476f88282b29949001a4, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.642764 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.657100 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1388/2791] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:13:44 2022] PUT /identity/v3/projects/bd8e07dc452141c5ad445b9eb808369d/users/317c4b7b042c476f88282b29949001a4/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:13:44.667395 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.667678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.667980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.696334 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] MFA Rules not processed for user `317c4b7b042c476f88282b29949001a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:13:44.697555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:44.737097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:44.766161 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1404/2792] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:13:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:13:44.777460 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:13:44.779140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:13:44.839326 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f4ef-46d1-4b1a-948d-a0eca6c95162 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:13:44.844873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:13:44.845499 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:13:44.845777 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:13:44.846048 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:13:44.852655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:44.855461 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:13:44.857406 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:13:44.869015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1389/2793] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:13:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:13:54.762900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:54.867811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:12.041038 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:14:12.042469 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:12.055282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc581-7c2d-475e-b316-20f5eb26de00 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:14:12.058870 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:14:12.059476 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:12.059753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:12.060058 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:12.061768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:12.144498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:14:12.145834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:14:12.165927 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1405/2794] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:14:14.726960 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:14:14.728397 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:14.785237 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e6472-297a-43a4-8547-afbabe416996 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:14:14.789339 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:14:14.790041 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:14.790421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:14.790792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:14.792658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:14.806475 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:14:14.807894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7a1e7-5d03-4069-85ef-285ebd57723d service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:14:14.819462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1390/2795] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:14:22.163512 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=43 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:22.192805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:14:22.254940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773970b4-c2a0-449f-9e0f-86c78b4a78c5 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:14:22.259393 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:14:22.260073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:22.260346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:22.260610 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] PATH_INFO: `/v3/users/317c4b7b042c476f88282b29949001a4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:22.261763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317c4b7b042c476f88282b29949001a4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:14:22.264346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:14:22.311586 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317c4b7b042c476f88282b29949001a4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.312273 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317c4b7b042c476f88282b29949001a4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.324128 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317c4b7b042c476f88282b29949001a4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.330898 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317c4b7b042c476f88282b29949001a4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.337809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317c4b7b042c476f88282b29949001a4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.344460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1406/2796] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:14:22 2022] DELETE /identity/v3/users/317c4b7b042c476f88282b29949001a4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:14:22.349014 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:22.349501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:22.349607 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:22.369574 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:14:22.370779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:22.428151 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1391/2797] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:14:22.437926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:14:22.439346 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:22.497140 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579978f-8255-45fd-b45a-4af2c7482198 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:14:22.501062 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:14:22.501676 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:22.501956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:22.502228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:22.511165 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:14:22.512981 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:14:22.522296 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1407/2798] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:14:22.799501 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:14:22.801158 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:14:22.815995 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33182-2ba1-4cb3-ad0a-a53b881704b4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:14:22.821367 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:14:22.822015 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:14:22.822294 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:14:22.822565 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] PATH_INFO: `/v3/projects/bd8e07dc452141c5ad445b9eb808369d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:14:22.824834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8e07dc452141c5ad445b9eb808369d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:14:22.827108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:14:22.873814 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8e07dc452141c5ad445b9eb808369d', 'request_id': 'req-ebdd8d93-81a2-4904-884c-b991754d9835'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.880986 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8e07dc452141c5ad445b9eb808369d', 'request_id': 'req-ebdd8d93-81a2-4904-884c-b991754d9835'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.886628 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8e07dc452141c5ad445b9eb808369d', 'request_id': 'req-ebdd8d93-81a2-4904-884c-b991754d9835'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.898064 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] The token cache is being invalidate because project bd8e07dc452141c5ad445b9eb808369d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:14:22.898345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.898970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ebdd8d93-81a2-4904-884c-b991754d9835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:14:22.900500 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1392/2799] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:14:22 2022] DELETE /identity/v3/projects/bd8e07dc452141c5ad445b9eb808369d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:14:32.518212 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:32.895261 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:02.741542 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:02.744193 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:02.839537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd19c-6935-4ce2-b53c-23a94a05512d service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:02.914568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:02.915185 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:02.915455 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:02.915719 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:02.917500 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:02.931952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:02.933446 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:02.944551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1408/2800] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:15:06.091931 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:06.092469 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:06.092593 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:06.116268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] MFA Rules not processed for user `1aff2581168d4498ad3823ed3e4ff3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:15:06.117473 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:06.175286 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1393/2801] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:15:08.723877 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:08.725335 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:08.790159 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c08b-eb3a-46f2-9e13-a23ec58aa9dd service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:08.797085 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:08.797720 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:08.798076 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:08.798254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:08.800105 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:08.812489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:08.814139 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:08.824871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1409/2802] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:15:16.167494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=25 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:18.818919 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:31.289677 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:31.300520 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946d41-0506-4109-8a4d-f46c193014a9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:31.304228 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:31.304772 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:31.305043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:31.305305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:31.307163 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:31.375617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:31.377140 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:31.391498 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1394/2803] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:15:37.664780 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:37.666320 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:37.733191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:37.735945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:37.751743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6e5a-4a72-4c24-af02-4130dfbf5863 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:37.756988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:37.757191 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:37.757480 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:37.757752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] PATH_INFO: `/v3/users/6f89a5e4981e423b84d5f28b33bd9629` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:37.759076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f89a5e4981e423b84d5f28b33bd9629)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:37.761579 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:37.781585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5d05-eaaf-4d24-8034-b005bfc22362 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:37.786585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:37.787430 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:37.788052 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:37.788370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:37.790863 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:37.805246 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:37.806838 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:37.815993 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f89a5e4981e423b84d5f28b33bd9629'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:37.817754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1410/2804] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:15:37.823421 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f89a5e4981e423b84d5f28b33bd9629'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:37.824155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f89a5e4981e423b84d5f28b33bd9629'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:37.837415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f89a5e4981e423b84d5f28b33bd9629'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:37.845492 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f89a5e4981e423b84d5f28b33bd9629'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:37.852109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1395/2805] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:15:37 2022] DELETE /identity/v3/users/6f89a5e4981e423b84d5f28b33bd9629 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:15:38.025537 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:38.039805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6269fe7-4f89-4101-a9b5-abb4b29958fe service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:38.097361 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:38.098004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:38.098282 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:38.098555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] PATH_INFO: `/v3/projects/b0ab093edb944772ae7b6fd285178a43` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:38.099703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ab093edb944772ae7b6fd285178a43)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:38.101622 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:38.146402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ab093edb944772ae7b6fd285178a43', 'request_id': 'req-a06a933e-a545-40e2-b9b0-8df94525b5ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.152661 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ab093edb944772ae7b6fd285178a43', 'request_id': 'req-a06a933e-a545-40e2-b9b0-8df94525b5ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.158940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ab093edb944772ae7b6fd285178a43', 'request_id': 'req-a06a933e-a545-40e2-b9b0-8df94525b5ae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.171675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] The token cache is being invalidate because project b0ab093edb944772ae7b6fd285178a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:15:38.172206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.172836 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.174353 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1411/2806] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:15:38 2022] DELETE /identity/v3/projects/b0ab093edb944772ae7b6fd285178a43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:15:38.178840 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:38.180429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:38.193900 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5cde-13ef-47c5-abd6-313b1a6b1319 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:38.253171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:38.253755 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:38.254028 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:38.254320 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] PATH_INFO: `/v3/users/26df2e727a9644f1af972e84c24d4cf7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:38.255757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26df2e727a9644f1af972e84c24d4cf7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:38.257658 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:38.263066 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:38.306284 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26df2e727a9644f1af972e84c24d4cf7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.313568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26df2e727a9644f1af972e84c24d4cf7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.314247 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26df2e727a9644f1af972e84c24d4cf7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.325791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26df2e727a9644f1af972e84c24d4cf7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.333726 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26df2e727a9644f1af972e84c24d4cf7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.339580 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1396/2807] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:15:38 2022] DELETE /identity/v3/users/26df2e727a9644f1af972e84c24d4cf7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:15:38.521125 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:15:38.522655 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:15:38.547805 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a933e-a545-40e2-b9b0-8df94525b5ae admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:15:38.560864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:38.602262 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:15:38.602900 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:15:38.603170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:15:38.603434 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] PATH_INFO: `/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:15:38.604604 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db911458ccf4e9b9af54c004d3d1b8b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:15:38.606477 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:15:38.652545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db911458ccf4e9b9af54c004d3d1b8b', 'request_id': 'req-afcefbe7-676f-4f82-9af3-50753e93abb8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.659330 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db911458ccf4e9b9af54c004d3d1b8b', 'request_id': 'req-afcefbe7-676f-4f82-9af3-50753e93abb8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.665054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db911458ccf4e9b9af54c004d3d1b8b', 'request_id': 'req-afcefbe7-676f-4f82-9af3-50753e93abb8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.677751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] The token cache is being invalidate because project 5db911458ccf4e9b9af54c004d3d1b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:15:38.678036 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.678656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:15:38.680200 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1412/2808] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:15:38 2022] DELETE /identity/v3/projects/5db911458ccf4e9b9af54c004d3d1b8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:15:48.336179 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:48.674753 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:26.231771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:26.233424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:26.247559 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07e6e-c587-45ac-a6ac-27e9cd99efe3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:26.310198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:26.310835 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.311112 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.311381 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] PATH_INFO: `/v3/users/1aff2581168d4498ad3823ed3e4ff3f9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.312561 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aff2581168d4498ad3823ed3e4ff3f9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:26.315111 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:26.359301 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aff2581168d4498ad3823ed3e4ff3f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.367142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aff2581168d4498ad3823ed3e4ff3f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.367838 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aff2581168d4498ad3823ed3e4ff3f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.381354 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aff2581168d4498ad3823ed3e4ff3f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.388956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-307de243-4cde-4bf6-bc01-885aa4c8a05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aff2581168d4498ad3823ed3e4ff3f9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.394917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1397/2809] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:16:26 2022] DELETE /identity/v3/users/1aff2581168d4498ad3823ed3e4ff3f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:26.572774 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:26.575130 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:26.595794 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefbe7-676f-4f82-9af3-50753e93abb8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:26.659673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:26.660347 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.660619 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.660914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] PATH_INFO: `/v3/projects/d3f34fc2ca3d4b32be53a5658100a336` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.662197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f34fc2ca3d4b32be53a5658100a336)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:26.664162 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:26.710141 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f34fc2ca3d4b32be53a5658100a336', 'request_id': 'req-06062733-5790-4670-9994-ee95ac6dd471'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.716168 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f34fc2ca3d4b32be53a5658100a336', 'request_id': 'req-06062733-5790-4670-9994-ee95ac6dd471'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.725675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f34fc2ca3d4b32be53a5658100a336', 'request_id': 'req-06062733-5790-4670-9994-ee95ac6dd471'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.738034 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] The token cache is being invalidate because project d3f34fc2ca3d4b32be53a5658100a336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:16:26.738325 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.738938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-06062733-5790-4670-9994-ee95ac6dd471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:26.740530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1413/2810] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:16:26 2022] DELETE /identity/v3/projects/d3f34fc2ca3d4b32be53a5658100a336 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:26.745554 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.745841 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.746138 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.765910 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:26.767109 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:26.828552 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1398/2811] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:16:26.836597 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.836881 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.837157 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.857448 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:26.858652 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:26.867287 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1414/2812] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:26.876400 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:26.886895 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b20e-cdf8-4131-97ed-d2682caf945d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:26.891403 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:26.892038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.892316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.892586 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.893277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:16:26.893576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:26.895162 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:26.912334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1399/2813] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:16:26.916884 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:26.927956 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c794-3835-4ba7-b5bb-c52be437afcb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:26.932692 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:26.933326 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:26.933601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:26.933869 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:26.934540 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:26.936498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:26.974729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1415/2814] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:16:26 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:26.979752 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:26.990239 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feaa06-9f65-4fa2-bf01-110f63af4f97 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:26.993819 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:27.050734 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:27.051351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.051627 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.051933 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.052605 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:27.054493 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:27.074812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1400/2815] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:16:26 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:27.079688 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:27.090066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554cb3-ab23-46bd-befe-a9c162afd58c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:27.095384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:27.096037 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.096321 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.096594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.097279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:27.098893 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:27.108871 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1416/2816] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:27.112955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:27.122956 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d6-2bb6-4ef1-a659-35a9a241bf24 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:27.127576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:27.128205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.128490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.128757 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.129445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:27.131005 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085959c4-3cb1-47d6-8d4e-2a036eac1564 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:27.142120 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1401/2817] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:27.145959 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:27.156147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfa59-587c-48e1-a1dd-bb0683602e6f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:27.161300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:27.161950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.162228 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.162498 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] PATH_INFO: `/v3/projects/5def2eb6b4e047c8890f3b43f7062e70/users/9f1b068b2d5c41e29288be905b2cbb87/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.177127 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5def2eb6b4e047c8890f3b43f7062e70, user_id=9f1b068b2d5c41e29288be905b2cbb87, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:27.180009 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:27.192630 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1417/2818] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:27 2022] PUT /identity/v3/projects/5def2eb6b4e047c8890f3b43f7062e70/users/9f1b068b2d5c41e29288be905b2cbb87/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:16:27.204357 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.204733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.205010 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.232316 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] MFA Rules not processed for user `9f1b068b2d5c41e29288be905b2cbb87`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:27.233513 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:27.302038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1402/2819] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:16:27.312943 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:27.314645 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:27.336149 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:27.393777 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71b63-eeec-4c94-ad52-353705bc2e63 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:27.399654 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6f07c961a46329912067a520beae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:27.400298 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:27.400574 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:27.400842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:27.408861 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:27.410424 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbb367-b18e-46a8-aee9-328459b2ac1b service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:27.419536 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1418/2820] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:34.710598 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:34.769370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bf82-54d8-4464-be21-1f659e716f0e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:34.774171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:34.774805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:34.775083 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:34.775351 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] PATH_INFO: `/v3/users/9f1b068b2d5c41e29288be905b2cbb87` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:34.776526 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1b068b2d5c41e29288be905b2cbb87)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:34.778413 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:34.794952 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:34.832728 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1b068b2d5c41e29288be905b2cbb87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:34.839377 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1b068b2d5c41e29288be905b2cbb87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:34.840129 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1b068b2d5c41e29288be905b2cbb87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:34.852375 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1b068b2d5c41e29288be905b2cbb87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:34.862144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1b068b2d5c41e29288be905b2cbb87'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:34.868822 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1403/2821] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:16:34 2022] DELETE /identity/v3/users/9f1b068b2d5c41e29288be905b2cbb87 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:34.873306 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:34.873816 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:34.874054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:34.892153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:34.893379 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:34.951979 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1419/2822] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:34.961975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:34.963359 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:35.020037 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014709-558e-4562-a11e-d151044b0b3f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.023992 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.024963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.024963 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.025199 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.034622 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.036060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea74ad2-1ac5-4204-93f8-ae2a65a197dc service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.049124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1404/2823] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:35.324855 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.326363 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:35.339406 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62813-8c5c-4a7d-add1-89ed9363e2d8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.344748 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.345602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.345730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.345996 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] PATH_INFO: `/v3/projects/5def2eb6b4e047c8890f3b43f7062e70` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.347195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5def2eb6b4e047c8890f3b43f7062e70)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.349117 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.399687 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5def2eb6b4e047c8890f3b43f7062e70', 'request_id': 'req-2cf359eb-ac7e-4578-bde2-72375562355f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:35.406531 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5def2eb6b4e047c8890f3b43f7062e70', 'request_id': 'req-2cf359eb-ac7e-4578-bde2-72375562355f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:35.413132 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5def2eb6b4e047c8890f3b43f7062e70', 'request_id': 'req-2cf359eb-ac7e-4578-bde2-72375562355f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:35.434014 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] The token cache is being invalidate because project 5def2eb6b4e047c8890f3b43f7062e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:16:35.434305 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:35.434944 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2cf359eb-ac7e-4578-bde2-72375562355f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:35.436487 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1420/2824] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:16:35 2022] DELETE /identity/v3/projects/5def2eb6b4e047c8890f3b43f7062e70 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:35.442706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.442999 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.443290 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.466991 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:35.468169 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:35.528730 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1405/2825] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:35.537629 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.537914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.538189 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.557965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:35.559158 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:35.567833 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1421/2826] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:35.572194 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.582917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d12af-ef98-495d-9f20-734af1b28203 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.587487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.588154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.588430 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.588699 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.589383 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:16:35.589682 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.591257 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.602771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1406/2827] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:16:35.607093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.617238 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041807e-9d35-4230-bc44-78cc3e5088dc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.621929 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.622564 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.622845 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.623114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.623803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.626583 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.647530 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:35.655909 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1422/2828] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:35.660124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.670081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa17f-2d63-43a2-bd5f-aef55e194cc0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.691594 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:35.738404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.739077 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.739212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.739464 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.740170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.742124 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.768625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1407/2829] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:35.772808 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.784108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89cda-95b3-4a5b-b83f-999965acb7d1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.789053 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.789765 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.790097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.790388 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.791144 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.793397 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.803766 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1423/2830] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:35.807830 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.818384 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c952b0-366a-4b9f-9eb2-f5e871c6c596 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.823243 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.823876 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.824155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.824424 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.825143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.826716 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baeffed-8a9f-4957-b352-75659c5d3d35 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.838054 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1408/2831] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:35.842106 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:35.853007 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d51df-4a0b-42a4-9626-c5377a4a3ee9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:35.857589 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:35.858237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.858510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.858776 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] PATH_INFO: `/v3/projects/8b5f8f8f834348c9a4b6f92bdd19fc17/users/14f88ae65d6f46c4b7f886772ee4e077/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.874210 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5f8f8f834348c9a4b6f92bdd19fc17, user_id=14f88ae65d6f46c4b7f886772ee4e077, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:35.877244 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:35.889752 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1424/2832] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:35 2022] PUT /identity/v3/projects/8b5f8f8f834348c9a4b6f92bdd19fc17/users/14f88ae65d6f46c4b7f886772ee4e077/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:35.900305 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:35.900691 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:35.900964 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:35.929345 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] MFA Rules not processed for user `14f88ae65d6f46c4b7f886772ee4e077`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:35.930529 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:35.994936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1409/2833] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:35.999550 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.063756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1832-14a9-49b1-af62-745a644bf9e6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.068809 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.069416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.069694 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.070089 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.070763 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.072762 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.104086 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1425/2834] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:16:35 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:36.108610 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.119611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7971d-184c-49d3-b62f-d3fbbee1344d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.176436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.177049 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.177342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.177640 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.178327 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.180438 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.201678 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1410/2835] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:16:36 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:36.205942 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.216383 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651533f-6fac-4622-961f-77d7bbe4d76d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.221098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.221702 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.221976 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.222245 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.222935 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.224591 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.235551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1426/2836] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:36.239929 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.249788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d70-d3c9-41bd-8e74-33d8dff19279 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.255920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.256948 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.257076 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.257262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] PATH_INFO: `/v3/projects/013da845cff04e998512b1e4ca052cf5/users/acc374bfea1e4746a7621a8932fe7b1e/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.272778 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=013da845cff04e998512b1e4ca052cf5, user_id=acc374bfea1e4746a7621a8932fe7b1e, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.275369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.284337 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:36.292283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1411/2837] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:36 2022] PUT /identity/v3/projects/013da845cff04e998512b1e4ca052cf5/users/acc374bfea1e4746a7621a8932fe7b1e/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:36.296316 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.307675 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7313c1-5e55-45d4-9fa7-1d360942cf1e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.366937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.367535 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.367834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.368124 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.368785 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.370358 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf12a3-e915-458b-974c-785057f5a13d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.380114 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1427/2838] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:36.384336 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.395415 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca8fa-506c-4c28-906a-be623e1dbe6b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.400372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.401023 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.401296 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.401563 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] PATH_INFO: `/v3/projects/013da845cff04e998512b1e4ca052cf5/users/acc374bfea1e4746a7621a8932fe7b1e/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.403490 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=013da845cff04e998512b1e4ca052cf5, user_id=acc374bfea1e4746a7621a8932fe7b1e, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.406157 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.417823 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1412/2839] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:36 2022] PUT /identity/v3/projects/013da845cff04e998512b1e4ca052cf5/users/acc374bfea1e4746a7621a8932fe7b1e/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:16:36.492914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.493195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.493468 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.521707 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] MFA Rules not processed for user `acc374bfea1e4746a7621a8932fe7b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:36.522801 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:36.542864 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:36.596940 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1428/2840] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:36.608997 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.611313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:36.669926 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260676b-f43c-495c-aec6-fe47046c0f6d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.674644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.675262 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.675540 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.675872 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.685342 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.686744 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.696252 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1413/2841] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:36.771570 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:36.782735 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84b78-72e3-46f2-9976-c80be43875c2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:36.788847 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:36.789862 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:36.790313 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:36.790732 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:36.849926 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:36.851355 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708661-a091-46a0-b363-f4b281ff961b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:36.860628 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1429/2842] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:45.861975 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:45.922733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fc3bf-86e7-4b79-9371-34859ecb0cec service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:45.927743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:45.928402 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:45.928674 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:45.928944 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] PATH_INFO: `/v3/users/14f88ae65d6f46c4b7f886772ee4e077` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:45.930094 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f88ae65d6f46c4b7f886772ee4e077)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:45.932013 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:45.977195 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f88ae65d6f46c4b7f886772ee4e077'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:45.984208 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f88ae65d6f46c4b7f886772ee4e077'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:45.985060 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f88ae65d6f46c4b7f886772ee4e077'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:45.997411 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f88ae65d6f46c4b7f886772ee4e077'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.005274 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f88ae65d6f46c4b7f886772ee4e077'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.011171 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1414/2843] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:16:45 2022] DELETE /identity/v3/users/14f88ae65d6f46c4b7f886772ee4e077 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:46.015672 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:46.016203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:46.016332 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:46.036873 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:46.038055 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:46.096555 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1430/2844] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:46.106437 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:46.107940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:46.121012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:46.171212 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aa818-23f7-4894-819e-5ca742d57b4a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:46.175099 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:46.175702 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:46.176003 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:46.176269 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:46.185313 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:46.186704 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:46.196775 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1415/2845] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:46.466108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:46.467545 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:46.480633 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af52f5-1246-49e5-9cbd-732184257d2e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:46.485201 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:46.485965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:46.486400 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:46.486971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] PATH_INFO: `/v3/projects/8b5f8f8f834348c9a4b6f92bdd19fc17` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:46.488184 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5f8f8f834348c9a4b6f92bdd19fc17)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:46.490067 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:46.537968 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5f8f8f834348c9a4b6f92bdd19fc17', 'request_id': 'req-19992a01-54eb-4a81-b011-8d8307099655'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.539834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:46.544439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5f8f8f834348c9a4b6f92bdd19fc17', 'request_id': 'req-19992a01-54eb-4a81-b011-8d8307099655'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.550788 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5f8f8f834348c9a4b6f92bdd19fc17', 'request_id': 'req-19992a01-54eb-4a81-b011-8d8307099655'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.562519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] The token cache is being invalidate because project 8b5f8f8f834348c9a4b6f92bdd19fc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:16:46.562796 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.563401 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.564965 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1431/2846] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:16:46 2022] DELETE /identity/v3/projects/8b5f8f8f834348c9a4b6f92bdd19fc17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:46.568981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:46.578916 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c853050-7d0f-47f2-bfa4-11e03a7b6300 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:46.635988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:46.636625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:46.636905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:46.637181 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] PATH_INFO: `/v3/users/acc374bfea1e4746a7621a8932fe7b1e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:46.638390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc374bfea1e4746a7621a8932fe7b1e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:46.640268 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:46.686373 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc374bfea1e4746a7621a8932fe7b1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.693081 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc374bfea1e4746a7621a8932fe7b1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.693743 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc374bfea1e4746a7621a8932fe7b1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.705905 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc374bfea1e4746a7621a8932fe7b1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.713074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7a3a10ce-f5c8-4711-935f-1a0e4818b5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc374bfea1e4746a7621a8932fe7b1e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:46.718898 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1416/2847] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:16:46 2022] DELETE /identity/v3/users/acc374bfea1e4746a7621a8932fe7b1e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:47.001803 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.004192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:47.025028 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992a01-54eb-4a81-b011-8d8307099655 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.081220 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.081842 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.082113 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.082375 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] PATH_INFO: `/v3/projects/013da845cff04e998512b1e4ca052cf5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.083514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013da845cff04e998512b1e4ca052cf5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.085478 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.134751 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013da845cff04e998512b1e4ca052cf5', 'request_id': 'req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:47.140640 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013da845cff04e998512b1e4ca052cf5', 'request_id': 'req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:47.146667 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013da845cff04e998512b1e4ca052cf5', 'request_id': 'req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:47.166717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] The token cache is being invalidate because project 013da845cff04e998512b1e4ca052cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:16:47.166997 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:47.167627 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d9e9bab1-5bb2-4e2e-8c60-5c042b14c456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:16:47.169188 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1432/2848] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:16:47 2022] DELETE /identity/v3/projects/013da845cff04e998512b1e4ca052cf5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:47.174603 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.175101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.175101 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.196052 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:47.197360 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:47.220788 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:47.258712 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1417/2849] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:47.266311 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.266585 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.266850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.286197 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:47.287373 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:47.295203 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1433/2850] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:47.299951 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.309616 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62eae5-b315-44a5-9b25-a900d5210ce3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.314127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.315333 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.315609 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.315915 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.316635 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:16:47.316936 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.318636 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.329955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1418/2851] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:16:47.334449 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.346093 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74931-ac10-4c17-af23-fdd6ea928846 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.350868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.351475 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.351750 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.352049 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.352703 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.354568 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.382275 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1434/2852] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:16:47.386393 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.396945 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303fb8-0153-433f-a413-d87a0f2f5154 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.453154 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.453769 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.454042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.454310 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.454967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.457496 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.478404 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1419/2853] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:47.482576 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.493192 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631a08-f131-45f5-8bb6-54371693c8b7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.497768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.498371 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.498642 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.498912 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.499598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.501206 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.511914 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1435/2854] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:47.515825 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.526577 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfaef-16f0-422e-9198-2c22d286dc4f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.531524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.532283 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.532570 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.533044 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.534737 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.536338 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3542f-8b9a-43a3-a7e6-409465ddee02 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.547056 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1420/2855] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:47.551729 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.561593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a2b93-21fd-4507-8a32-3614f48807ff admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.566754 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.567402 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.567678 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.567977 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] PATH_INFO: `/v3/projects/279bc96e715644ce8c34a7bad10b42f0/users/2bf8d7a32ccd40ff972b446305a418d7/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.582925 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279bc96e715644ce8c34a7bad10b42f0, user_id=2bf8d7a32ccd40ff972b446305a418d7, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.585584 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.598832 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1436/2856] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:47 2022] PUT /identity/v3/projects/279bc96e715644ce8c34a7bad10b42f0/users/2bf8d7a32ccd40ff972b446305a418d7/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:47.610061 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.610343 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.610617 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.639855 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] MFA Rules not processed for user `2bf8d7a32ccd40ff972b446305a418d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:47.641051 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:47.710643 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1421/2857] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:47.715021 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.724502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:47.782263 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf93d7-89c0-4177-94c1-c1e7d4b244f7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.787472 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.788097 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.788370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.788637 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.789292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.791384 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.817724 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1437/2858] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:47.821774 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.832805 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31aaf-07a6-469d-835e-6ebca250881e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.853043 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:47.891700 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.892348 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.893293 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.893784 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.894553 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.896487 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.917115 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1422/2859] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:16:47 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:16:47.921143 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.932108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e59b6-c480-4993-9f9c-cd0f2bb8aa7f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.936673 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.937279 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.937558 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.937826 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.938514 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.940734 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:47.951044 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1438/2860] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:16:47.955022 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:47.965571 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998b5c-178e-448e-a220-694d4651530b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:47.970108 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:47.971470 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:47.971868 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:47.972137 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] PATH_INFO: `/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088/users/718418f085ae41b4ae549c5d13eb758d/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:47.987168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9357caaa094f5fa7c80f09dc0fa088, user_id=718418f085ae41b4ae549c5d13eb758d, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:47.989820 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:48.002504 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1423/2861] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:47 2022] PUT /identity/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088/users/718418f085ae41b4ae549c5d13eb758d/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:48.006696 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:48.016712 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4c7e-6e4b-48ac-9d89-0c0099ce67f0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:48.073458 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:48.074122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:48.074337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:48.074611 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:48.075300 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:48.076920 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6166fe-6176-424a-8247-e57483a7a7f3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:48.087513 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1439/2862] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:16:48.091882 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:48.102763 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eea3-e675-4d01-ab55-02a4861ed3a3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:48.107655 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:48.108347 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:48.108625 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:48.108894 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] PATH_INFO: `/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088/users/718418f085ae41b4ae549c5d13eb758d/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:48.111178 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9357caaa094f5fa7c80f09dc0fa088, user_id=718418f085ae41b4ae549c5d13eb758d, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:48.114955 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:48.125127 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1424/2863] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:16:48 2022] PUT /identity/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088/users/718418f085ae41b4ae549c5d13eb758d/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:16:48.136153 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:48.136435 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:48.136705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:48.164691 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] MFA Rules not processed for user `718418f085ae41b4ae549c5d13eb758d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:16:48.166265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:48.241489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1440/2864] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:16:48.252935 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:48.255242 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:16:48.311223 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04eec-f76b-4022-b34b-a87ef0204a40 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:48.315436 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:48.316074 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:48.316349 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:48.316614 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:48.371144 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:48.372590 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:48.382125 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1425/2865] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:52.989337 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:16:52.993590 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:53.000437 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478edb7f-7357-49ba-b18d-caa2562ac11c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:16:53.005073 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:16:53.005681 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:16:53.005955 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:16:53.006223 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:16:53.015348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:16:53.016783 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a205-826e-493d-b30a-9b9370e8e474 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:16:53.026841 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1441/2866] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:16:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:16:58.377893 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:03.022850 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:14.819205 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:14.887027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e123a6-9d1b-430c-abad-e90ddc25cde4 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:14.891497 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:14.892153 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:14.892429 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:14.892696 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] PATH_INFO: `/v3/users/2bf8d7a32ccd40ff972b446305a418d7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:14.893834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf8d7a32ccd40ff972b446305a418d7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:14.896334 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:14.942522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf8d7a32ccd40ff972b446305a418d7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:14.949256 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf8d7a32ccd40ff972b446305a418d7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:14.949917 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf8d7a32ccd40ff972b446305a418d7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:14.962641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf8d7a32ccd40ff972b446305a418d7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:14.970174 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf8d7a32ccd40ff972b446305a418d7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:14.977143 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1426/2867] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:17:14 2022] DELETE /identity/v3/users/2bf8d7a32ccd40ff972b446305a418d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:14.981827 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:14.982319 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:14.982431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:15.001118 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:15.002292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:15.068309 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1442/2868] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:15.078446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:15.079796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:15.135798 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5aaa5-bf5d-4560-92ab-e6023af52f40 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:15.139370 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:15.140007 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:15.140280 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:15.140576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:15.150537 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:15.151981 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:15.161967 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1427/2869] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:17:15.678784 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:15.680241 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:15.693510 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ed8f-2759-4239-be6c-22899bc4c62c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:15.698307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:15.699026 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:15.699370 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:15.699705 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] PATH_INFO: `/v3/projects/279bc96e715644ce8c34a7bad10b42f0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:15.701147 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=279bc96e715644ce8c34a7bad10b42f0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:15.703519 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:15.750575 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279bc96e715644ce8c34a7bad10b42f0', 'request_id': 'req-ba6bc2a6-13bf-469e-964b-5171081b9d6d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.756768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279bc96e715644ce8c34a7bad10b42f0', 'request_id': 'req-ba6bc2a6-13bf-469e-964b-5171081b9d6d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.762265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279bc96e715644ce8c34a7bad10b42f0', 'request_id': 'req-ba6bc2a6-13bf-469e-964b-5171081b9d6d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.775492 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] The token cache is being invalidate because project 279bc96e715644ce8c34a7bad10b42f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:17:15.775717 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.776527 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.778017 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1443/2870] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:17:15 2022] DELETE /identity/v3/projects/279bc96e715644ce8c34a7bad10b42f0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:15.781973 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:15.792690 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554d3d-d316-4566-8e3a-c31cb3a7a24d service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:15.811073 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:15.851797 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:15.852507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:15.852706 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:15.852980 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] PATH_INFO: `/v3/users/718418f085ae41b4ae549c5d13eb758d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:15.854142 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=718418f085ae41b4ae549c5d13eb758d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:15.856091 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:15.902816 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718418f085ae41b4ae549c5d13eb758d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.909445 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718418f085ae41b4ae549c5d13eb758d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.910196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718418f085ae41b4ae549c5d13eb758d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.922168 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718418f085ae41b4ae549c5d13eb758d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.929665 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ec6f930a-f386-4f55-bb12-f30322d91d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718418f085ae41b4ae549c5d13eb758d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:15.935606 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1428/2871] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:17:15 2022] DELETE /identity/v3/users/718418f085ae41b4ae549c5d13eb758d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:16.211099 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.212602 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:16.228658 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc2a6-13bf-469e-964b-5171081b9d6d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.289488 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.290138 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.290416 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.290690 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] PATH_INFO: `/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.291856 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9357caaa094f5fa7c80f09dc0fa088)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.293768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.324547 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:16.342266 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9357caaa094f5fa7c80f09dc0fa088', 'request_id': 'req-6fa3a7db-3228-4df7-a4d4-8338153047e9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:16.349116 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9357caaa094f5fa7c80f09dc0fa088', 'request_id': 'req-6fa3a7db-3228-4df7-a4d4-8338153047e9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:16.354656 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9357caaa094f5fa7c80f09dc0fa088', 'request_id': 'req-6fa3a7db-3228-4df7-a4d4-8338153047e9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:16.368599 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] The token cache is being invalidate because project 0d9357caaa094f5fa7c80f09dc0fa088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:17:16.368885 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:16.369504 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6fa3a7db-3228-4df7-a4d4-8338153047e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:16.371012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1444/2872] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:17:16 2022] DELETE /identity/v3/projects/0d9357caaa094f5fa7c80f09dc0fa088 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:16.376000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.376292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.376569 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.396488 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:16.397942 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:16.461031 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1429/2873] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:16.468967 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.469252 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.469523 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.489865 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:16.491199 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:16.499071 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1445/2874] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:16.503196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.513954 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837906-f695-4858-bbbd-c0e1f2ae515c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.518468 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.519092 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.519372 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.519644 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.520363 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:17:16.520663 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.522491 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.533791 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1430/2875] 10.222.0.95 () {58 vars in 1153 bytes} [Fri Aug 5 20:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:17:16.538312 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.547521 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc938-0a2f-4382-8ab0-84da686b44ea None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.552813 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.553410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.553684 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.553950 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.554598 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.556502 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.583122 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1446/2876] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:17:16.587550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.597811 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68555e8-7610-4a9f-9021-02df884b94f6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.624550 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:16.659419 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.660071 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.660514 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.660792 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.661444 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.663390 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.684335 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1431/2877] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:17:16.688582 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.699548 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec88848-c919-4193-84c6-69df86e87e4e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.704108 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.704711 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.705004 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.705254 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.705937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.707594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.717664 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1447/2878] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:17:16.721649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.733147 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93325a-dca1-4203-89ed-a6dfa1b5e4ec admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.737729 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.738903 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.739176 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.739446 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.740170 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.741733 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd55c-4741-49f2-b6a0-62ad598e8538 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.752323 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1432/2879] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:17:16.756439 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.766250 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ae055-a6dd-4e8f-91cf-c656aeebc6fa admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.770958 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.771600 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.772410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.772410 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] PATH_INFO: `/v3/projects/acaf49a61bc546b3b4e1b805ecdb39c8/users/468768e72dcb4570b7aa76815988bc06/roles/2c8acee661db441aae043379c7020618` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.787511 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaf49a61bc546b3b4e1b805ecdb39c8, user_id=468768e72dcb4570b7aa76815988bc06, role_id=2c8acee661db441aae043379c7020618)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.790170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:16.803145 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1448/2880] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:17:16 2022] PUT /identity/v3/projects/acaf49a61bc546b3b4e1b805ecdb39c8/users/468768e72dcb4570b7aa76815988bc06/roles/2c8acee661db441aae043379c7020618 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:16.813219 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.813503 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.813796 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.842834 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] MFA Rules not processed for user `468768e72dcb4570b7aa76815988bc06`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:16.844087 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:16.907913 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1433/2881] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:16.912593 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:16.973648 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166198-b633-478c-b13f-bde570b800b5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:16.978137 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:16.978742 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:16.979018 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:16.979290 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:16.979969 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:16.981849 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.008992 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1449/2882] 10.222.0.95 () {60 vars in 1153 bytes} [Fri Aug 5 20:17:16 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:17:17.013034 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.024534 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486761d-eee5-4007-a817-bd20d958d1c8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.080779 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.081448 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.082248 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.082522 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.083196 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.085309 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.107055 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1434/2883] 10.222.0.95 () {60 vars in 1144 bytes} [Fri Aug 5 20:17:17 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:17:17.111041 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.121631 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8b51-25ed-44a8-9a8e-c0b908c23f83 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.126195 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.126799 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.127077 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.127348 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.128060 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.129980 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.140834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1450/2884] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:17:17.145524 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.155576 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e047e4-5919-4060-b96b-6d08ca1dd541 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.160902 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.161669 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.161947 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.162214 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] PATH_INFO: `/v3/projects/69f29b41d26d412299fe8363536ec0b2/users/b3e40c730883401a82ea090fb7d29982/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.176857 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f29b41d26d412299fe8363536ec0b2, user_id=b3e40c730883401a82ea090fb7d29982, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.179568 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.192285 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1435/2885] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:17:17 2022] PUT /identity/v3/projects/69f29b41d26d412299fe8363536ec0b2/users/b3e40c730883401a82ea090fb7d29982/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:17:17.196194 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.206070 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539ebc3-84c6-4556-89c2-f570aada7e47 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.226793 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:17.264292 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.264937 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.265237 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.265507 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.266328 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.267938 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8aa8d-03b1-44ea-9ac2-74f8f0e9038f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.278952 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1451/2886] 10.222.0.95 () {58 vars in 1122 bytes} [Fri Aug 5 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:17:17.283038 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.289369 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:17.295694 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516eca96-9fdf-44c9-a62e-d3bd587dc647 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.301079 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.301745 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.302025 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.302300 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] PATH_INFO: `/v3/projects/69f29b41d26d412299fe8363536ec0b2/users/b3e40c730883401a82ea090fb7d29982/roles/bd74bcf2875d4a938459935e6c4fdc20` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.304307 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f29b41d26d412299fe8363536ec0b2, user_id=b3e40c730883401a82ea090fb7d29982, role_id=bd74bcf2875d4a938459935e6c4fdc20)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.306920 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.317399 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1436/2887] 10.222.0.95 () {60 vars in 1483 bytes} [Fri Aug 5 20:17:17 2022] PUT /identity/v3/projects/69f29b41d26d412299fe8363536ec0b2/users/b3e40c730883401a82ea090fb7d29982/roles/bd74bcf2875d4a938459935e6c4fdc20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:17.327616 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.327933 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.328217 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.360098 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] MFA Rules not processed for user `b3e40c730883401a82ea090fb7d29982`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:17.361307 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:17.429288 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1452/2888] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:17.440374 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.442940 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:17.499812 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d6ffb-feca-4e0e-b47c-681feaab435e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.503249 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb2b5b52ee4b0eaa5a1a0c04b6b1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.504494 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.504771 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.505035 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.513983 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.515391 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bb562-8b3a-4752-acf5-ccbcc9f343b8 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.525649 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1437/2889] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:17:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:17:17.592387 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.656054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3878b9-c40c-4597-8c93-3f71b300785b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.660643 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.661281 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.661607 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.661831 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] PATH_INFO: `/v3/users/468768e72dcb4570b7aa76815988bc06` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.663011 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468768e72dcb4570b7aa76815988bc06)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.665003 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.712339 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468768e72dcb4570b7aa76815988bc06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:17.712991 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468768e72dcb4570b7aa76815988bc06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:17.714177 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:17.726971 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468768e72dcb4570b7aa76815988bc06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:17.736634 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468768e72dcb4570b7aa76815988bc06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:17.744834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468768e72dcb4570b7aa76815988bc06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:17.751222 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1453/2890] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:17:17 2022] DELETE /identity/v3/users/468768e72dcb4570b7aa76815988bc06 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:17.756670 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.756950 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.757277 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.776466 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] MFA Rules not processed for user `72bbdec94ebd4a7ead34c004dcfc40eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:17:17.777648 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:17.836078 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1438/2891] 10.222.0.95 () {58 vars in 958 bytes} [Fri Aug 5 20:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:17:17.845730 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:17.847170 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:17.904986 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a509-0e71-4949-a851-3ef5d8e43615 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:17.908594 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '732dac2174a84e28be298417ecc2370a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:17.909208 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:17.909484 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:17.909822 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:17.919265 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:17.920699 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:17.930538 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1454/2892] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:17:18.207012 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:18.208912 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:18.225042 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef96f58-8dbd-4541-b0d8-1a67b2828d48 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:18.230977 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:18.231988 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:18.232229 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:18.232626 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] PATH_INFO: `/v3/projects/acaf49a61bc546b3b4e1b805ecdb39c8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:18.234027 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaf49a61bc546b3b4e1b805ecdb39c8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:18.235970 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:18.287000 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaf49a61bc546b3b4e1b805ecdb39c8', 'request_id': 'req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.294611 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaf49a61bc546b3b4e1b805ecdb39c8', 'request_id': 'req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.300884 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaf49a61bc546b3b4e1b805ecdb39c8', 'request_id': 'req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.312224 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] The token cache is being invalidate because project acaf49a61bc546b3b4e1b805ecdb39c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:17:18.312507 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.313155 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.314754 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1439/2893] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:17:18 2022] DELETE /identity/v3/projects/acaf49a61bc546b3b4e1b805ecdb39c8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:18.318858 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:18.328764 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ffd2-3b65-4784-b432-6f82d02d68e7 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:18.387601 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:18.388283 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:18.388561 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:18.389431 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] PATH_INFO: `/v3/users/b3e40c730883401a82ea090fb7d29982` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:18.390609 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e40c730883401a82ea090fb7d29982)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:18.392551 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:18.450756 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e40c730883401a82ea090fb7d29982'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.451390 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e40c730883401a82ea090fb7d29982'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.464012 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e40c730883401a82ea090fb7d29982'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.468447 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:18.472916 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e40c730883401a82ea090fb7d29982'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.481588 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e40c730883401a82ea090fb7d29982'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.489746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1455/2894] 10.222.0.95 () {58 vars in 1224 bytes} [Fri Aug 5 20:17:18 2022] DELETE /identity/v3/users/b3e40c730883401a82ea090fb7d29982 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:17:18.776030 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:17:18.777641 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:17:18.793558 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae10d6-d07a-49e1-94aa-a0d8d9e1f210 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:17:18.808465 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:18.868292 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bbdec94ebd4a7ead34c004dcfc40eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f7a859119a4ba5a9748b0c556b058a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:17:18.868873 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:17:18.869149 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:17:18.869416 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] PATH_INFO: `/v3/projects/69f29b41d26d412299fe8363536ec0b2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:17:18.870545 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f29b41d26d412299fe8363536ec0b2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:17:18.872462 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:17:18.924198 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f29b41d26d412299fe8363536ec0b2', 'request_id': 'req-e4abfc19-a2d3-4082-96dc-cac7504d1455'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.931675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f29b41d26d412299fe8363536ec0b2', 'request_id': 'req-e4abfc19-a2d3-4082-96dc-cac7504d1455'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.937204 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f29b41d26d412299fe8363536ec0b2', 'request_id': 'req-e4abfc19-a2d3-4082-96dc-cac7504d1455'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.948701 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] The token cache is being invalidate because project 69f29b41d26d412299fe8363536ec0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:17:18.948976 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.949600 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e4abfc19-a2d3-4082-96dc-cac7504d1455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:17:18.951114 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1440/2895] 10.222.0.95 () {58 vars in 1233 bytes} [Fri Aug 5 20:17:18 2022] DELETE /identity/v3/projects/69f29b41d26d412299fe8363536ec0b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:17:28.484746 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:28.945675 dv-cinder-852211-3-iscsi devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:27.385134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:18:27.386549 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:18:27.456134 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92520-064b-4036-8f69-8786b434fc41 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:18:27.514868 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d6df032d6640deaac623bce31af91e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b90d7b9a40249da9de7a1ce9fd70675', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:18:27.515489 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:18:27.515768 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:18:27.516066 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:18:27.517834 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:18:27.529894 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:18:27.531460 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e85b7c-297a-4006-84f2-4a8ba2e5bb13 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:18:27.542324 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1456/2896] 10.222.0.95 () {60 vars in 1365 bytes} [Fri Aug 5 20:18:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:18:37.537054 dv-cinder-852211-3-iscsi devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=58 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}